2025-07-08
clustercontrol-controller-2.3.2-13612
clustercontrol-controller-2.3.3-13613

• Address an issue with the URL in email notifications not using 'https’ (CLUS-6106)
• Address an issue when editing HAProxy configuration not being reflected in the actual configuration file (CLUS-4782)

2025-07-02
clustercontrol2-2.3.2-2059
clustercontrol2-2.3.3-2060
clustercontrol-mcc-2.3.2-501
clustercontrol-mcc-2.3.3-502

• Support for a new dark mode theme with watch lists (CLUS-5780, ONLY in v2.3.3)
• Address an issue with the logs being spammed with 'User ccsetup was not found on LDAP'  (CLUS-5937)

2025-06-30
clustercontrol-controller-2.3.2-13534
clustercontrol-controller-2.3.3-13535

• Address a regression with MySQL PITR with binary logs not being downloaded based on parent backup ID (CLUS-6130)
• Address an potential improvement using the s9s cli when CMON is not responding during high load by ignoring SIGPIPE signal (CLUS-6117)
• Address an issue with the logs being spammed with 'User ccsetup was not found on LDAP'  (CLUS-5937)
• Address an issue with Elasticsearch deployments with a non-root user (CLUS-6033, CLUS-5677)

====

ClusterControl Ops-C v2.3.3
2025-06-25

clustercontrol2-2.3.3-2051
clustercontrol-mcc-2.3.3-491 clustercontrol-controller-2.3.3-13489
clustercontrol-kuber-proxy-0.1.0-589
clustercontrol-proxy-2.3.3-96
clustercontrol-cloud-2.3.3-432
clustercontrol-clud-2.3.3-423
clustercontrol-notifications-2.3.3-379
clustercontrol-ssh-2.3.3-221
s9s-tools 1.9.2025062518-release1

We’re pleased to announce the release of ClusterControl v2.3.3. This update introduces enhancements for elevated user privileges with Privileged Access Management integration of PowerBroker’s ‘pbrun’ as well as support for MongoDB 8.0 and MariaDB 11.8 LTS.

PowerBroker’s pbrun Integration
A replacement for sudo, offering more flexibility and control.

• Enhanced Security — Enables secure execution of privileged commands without exposing root credentials.
  • Granular privilege delegation — users can be permitted to run specific commands only under controlled conditions.
  • Centralized policy enforcement — access and permissions are defined by administrators in a central policy file, rather than on individual systems.
  • Audit trails and logging — all actions taken via pbrun are logged for accountability and compliance.
  • Role-based access control (RBAC) — different users or roles can be given distinct levels of privilege.
  • Seamless Integration: Easily use pbrun within ClusterControl for consistent and secure database management workflows.
  • This integration adds an additional layer of security and control for organizations with stringent privileged access requirements.

MongoDB 8.0

MongoDB 8.0, released in October 2024, introduces significant enhancements across performance, security, scalability, and developer experience.

MariaDB 11.8

This is the latest Long-Term Support (LTS) version, now generally available. This release brings major improvements in performance, observability, and AI-readiness.

• 🧠 AI-Ready with Native Vector Search - Unlock the power of generative AI and semantic search:
  • New VECTOR data type to store ML embeddings directly in tables
  • Vector indexing & distance functions (Cosine, Euclidean) for fast nearest-neighbor queries
• Ideal for RAG pipelines, personalized search, and recommendation engines—right inside your database.

Misc CC Ops-C / MCC UI improvements

• Admin User Registration Form - 'Advanced Self-Serve' intent and new 'Feedback' input
• Improvements to multi-cmon controller registration and authentication process

==============

2025-06-24
clustercontrol-controller-2.3.2-13451

• Address an issue wth PostgreSQL major upgrades when failover on replica was started before primary upgrade was finished (CLUS-6048)
• Address an issue with outgoing mail messages retention not being cleaned up correctly (CLUS-6098)
• Address additional improvements to clean up CMON logging (CLUS-6097)
• Address an improvement to update the PostgreSQL Prometheus exporter to v0.17.1 (CLUS-6007)
• Address an improvement to increase the default wal_keep_size value with CCX (CCX-5391)
• Address an improvement to output a warning message instead of 'fatal error' when trying to create a PostgreSQL database that already exists with the S9s CLI (CLUS-4645)

2025-06-18
clustercontrol-controller-2.3.2-13372
 

• Address an issue when hostname resolution (DNS) fails at CMON startup (CLUS-6064)
• Address an issue with cluster creation or import when Vault integration is enabled (CLUS-5846)

2025-06-13
clustercontrol-controller-2.3.2-13291
 

• Address an improvement with database growth accuracy with many schemas/databases. A new cmon configuration parameter has been introduced.

  # Determining how many largest databases will be examined, considering database growth. 
  # Default value is 20.
  
  database_growth_db_limit

• Address an issue with MSSQL backup retention not working properly (CLUS-6068)
• Address an issue to prevent setting the time_zone variable in the MySQL my.cnf file (CLUS-6059)
• Address an issue to prevent schema collection for PostgreSQL with CCX (CLUS-6071)

2025-06-11
clustercontrol2-2.3.2-2034
clustercontrol-mcc-2.3.2-475
 

• Address an issue when turning off autorecovery causing the page to go blank (CLUS-5951)
• Address improvements with bundle size (CLUS-4426)

2025-06-05
clustercontrol2-2.3.2-2024
clustercontrol-mcc-2.3.2-467
 

• Address an improvement when importing PostgreSQL clusters to customize 'service name' and 'configuration file' (CLUS-5951)
• Address an issue showing incorrect type when deploying MongoDB sharded cluster (CLUS-5934)
• Address an issue with the job spec when converting a MongoDB replicaset to a sharded cluster (CLUS-5901)
• Address a cosmetic issue with menu item’s clickable detection area (CLUS-5849) 

2025-06-03
clustercontrol-controller-2.3.2-13135
clustercontrol-controller-2.3.1-13136
 

• Address an improvement to handle special characters for PgBouncer export connection strings (CLUS-5950)
• Address an issue with 502 Proxy timeout error by

$ nano /usr/share/cmon/apache/cc-frontend-cmon-api.conf
# In the first <LocationMatch /api/v2/>
# append a timeout to the line:

ProxyPass https://127.0.0.1:9501/v2/ timeout=300

# Restart the Apache server
$ systemctl restart apache2.servicenano /usr/share/cmon/apache/cc-frontend-cmon-api.conf

# In the first <LocationMatch /api/v2/>
# append a timeout to the line:
ProxyPass https://127.0.0.1:9501/v2/ timeout=300

# Restart the Apache server
$ systemctl restart apache2.service

• Address an issue specifying the path for the Prometheus data directory being ignored (CLUS-5943)
• Address an issue with verify backup and a newly imported MariaDB / MySQL cluster with a minimal configuration setup (CLUS-5718)

2025-05-27
clustercontrol-controller-2.3.2-12981
 

• Address an improvement to handle OFFLINE_SOFT for ProxySQL. A configurable timeout can be set to raise an alarm after X seconds (CLUS-5732)

  • A new alarm type LbBackendDrainingTimeout was added that will be triggered for a load-balancer backend stuck in draining mode

  • This setting can be configured by lb_backend_draining_grace_sec (default = 300 sec (5 min); value <= 0 disables the alarm)

• Address an issue where a replica failed to be promoted after importing a MySQL/MariaDB cluster because credentials were missing in the cmon configuration (CLUS-5893)

2025-05-26
clustercontrol-mcc-2.3.2-457
clustercontrol-proxy-2.3.2-78

• Address an improvement to change the MCC root admin user’s password with 'ccmgradm setpassword <adminuser> <password>'  (CLUS-5955)
• Address an issue using an incorrect URL when trying to open web ssh (CLUS-5978)
• Address an improvement with LDAP authentication where authentication method is determined by the CMON controller settings and not cmon-proxy (CLUS-5931)
• Address an improvement with the Kubernetes agent deployment helm command to include the agent version (CLUS-5948)
• Address an improvement to truncate (very) long CMON Controller names (CLUS-5954)
• Address an issue to clarify what the MCC root user is used for (CLUS-5952) 

2025-05-22
clustercontrol-controller-2.3.2-12889

CMON Controller

• Address an issue where a new replica was not correctly added to the HAProxy RW configuration set (CLUS-5938)
• Address an issue when deploying SQL Server 2022 on RHEL 9 (CLUS-5367)

2025-05-21
clustercontrol-controller-2.3.2-12867

CMON Controller

• Address an issue where the data directory for Prometheus was ignored (CLUS-5943)
• Address improvements with importing PostgreSQL when the cluster_name is empty / not set (CLUS-5891, CLUS-5713)
• Address an issue with MariaDB 'verify backup' with incremental backup  (CLUS-5836)
• Address an issue restoring incremental backups with MariaDB (CLUS-5949)
• Address an issue where 'stop slave' fails without attempting to retry the command for MySQL (CLUS-5935)
• Address an issue where the backup verification server status is shown as ’Shutdown’ although it was still operational (CLUS-5720)

==

ClusterControl Ops-C v2.3.2

clustercontrol-mcc-2.3.2-446
clustercontrol-controller-2.3.2-12771
clustercontrol-kuber-proxy-0.1.0-39
clustercontrol-proxy-2.3.2-74
clustercontrol-cloud-2.3.2-423
clustercontrol-clud-2.3.2-423
clustercontrol-notifications-2.3.2-373
clustercontrol-ssh-2.3.2-213
s9s-tools 1.9.2025050921-release1 

===

We’re pleased to announce the release of ClusterControl Ops-C v2.3.2, aligning with the ClusterControl (CCv2 UI) version released in April.

This release marks a significant milestone with the introduction of a technical preview for Kubernetes-native database management.

This version introduces support for deploying and managing databases in Kubernetes using community-driven database operators through declarative, YAML-based configurations with built-in version control — laying the foundation for cloud-native database operations with ClusterControl.

Kubernetes Database Operators with ClusterControl - Technical Preview

• Supported Databases:
  • Easily deploy PostgreSQL and MySQL replication clusters to any Kubernetes environment.

• Supported Database Operators
  • PostgreSQL: cloudnative-pg
  • MySQL: Moco

• YAML based management with version control
  •  
    • Manage deployment and backups with access to the YAML configurations , ensuring flexibility and control over the database operator setups.

• Effortless scaling
  • Scale out or in by simply modifying the deployments

• Backup management
  • Manage backup schedules
  • Restore cluster from backups
  • Cloud object storage with S3 compliant cloud storage vendors

• UI Integration
  • Leverage ClusterControl’s intuitive uiser interface to manage and monitor databases deployed in Kubernetes, streamlining operations regardless of database environments.

This is an early preview release of Kubernetes operator support and not meant for production use. In the mean time we invite feedback from early adopters to help refine our roadmap and upcoming features.

ClusterControl Ops-C as the default application

Starting with this release, all new installations will default to ClusterControl Ops-C which features *Multi-CMON-Controller (scaling, multi-tenancy)* and *K8s databases* capabilities

• This is now default for Users who download and install CC using the https://severalnines.com/downloads/install-cc script
• The legacy LAMP stack with Apache is no longer included with the Ops-C stack. Apache has been replaced by the clustercontrol-proxy package which provides similar web server functionality.
• There is a parameter that can be used with the install-cc script '--ccv2' which will then proceed to install the previous LAMP stack with CCv2 instead

By default CC Ops-C does not have multiple-cmon-controllers (MCC) support enabled. It will need to be explicitly enabled by going to the Settings->License page (for now).

Initially for all users the UI will look and behave identical to CCv2 except for the new Kubernetes page. The Kubernetes page can be hidden for Users who do not want to use it by going to Settings->License page and click on 'Disable Kubernetes'. 

 ====================

2025-05-14
clustercontrol-controller-2.3.2-12771
clustercontrol2-2.3.2-2003

• Address an issue with a CMON segfault when deploying a MongoDB cluster with an arbiter node (CLUS-5894)
• Address an improvement with CMON when parsing MySQL slow queries results to prevent segfaults (CLUS-5899)

UI

• Address an issue to show the correct CMON controller version (CLUS-5813)
• Address an issue when editing the backup schedule's host (CLUS-5335)
• Address an issue using incorrect Galera logo (CLUS-5771)

2025-05-06
clustercontrol2-2.3.2-1975

• Address an issue using internal/private IP with ProxySQL (CLUS-5753)
• Address an improvement with Galera imports where vendor is now detected by CMON (CLUS-5784)
• Address an improvement to add 'search users to import' for ProxySQL (CLUS-5754)

2025-04-30
clustercontrol-controller-2.3.2-12664

• Address an issue with correctly identifying the vendor when importing Percona XtraDB Cluster (CLUS-5775)
• Address an issue failing to remove Valkey clusters (CCX, CLUS-5721)
• Address an improvement to provide a specific 'mariadb-dump' backup method with MariaDB (CLUS-5761)

2025-04-23
clustercontrol2-2.3.2-1964

• Address an issue when editing a backup schedule and trying to change/use every hour or minute (CLUS-5818)

2025-04-22
 

clustercontrol2-2.3.2-1962
clustercontrol-controller-2.3.2-12608 (2.3.0-12610, 2.3.1-12609)

CMON Controller

• Address an issue with LDAP permissions with the configuration page and download of error reports (CLUS-5803)
• Address an improvement to support a new Galera param: galera_flush_status_period to disable FLUSH STATUS when set to 0 (CLUS-5781)
  • Value is integer != 0 → check FLUSH STATUS exec every X secs
  • Value is == 0 → check FLUSH STATUS is never exec
  • Value is not a positive integer check it uses default value.
  • Default value is 0, disabled.
• Address an issue to prevent major upgrade attempt if a PostgreSQL cluster belongs to a logical cluster (CLUS-5644)
• Address an issue with Valkey Sentinel where the configuration gets read continuously (CLUS-5762)
• Address an improvement where MySQL transaction log and tables analytics is off  by default (CCX, CLUS-5773)
• Address an issue to add a 'valkey' backup method instead of 'redis' (CLUS-5757)

UI

• Address an issue where 'audit log' cluster menu item was missing with Percona Galera Pro 8.4 (CLUS-5705)
• Address an issue where 'PITR enable’ was incorrectly displayed with PostgreSQL (CLUS-5712)
• Address an issue with watchlist names to include character validation (CLUS-5777) 

2025-04-11
clustercontrol2-2.3.2-1953

• Address an issue when viewing ProxySQL deployment job details (CLUS-5782)

2025-04-10
clustercontrol2-2.3.2-1951

• Address additional issues with auto select primary vs replica when creating backup schedules (CLUS-5335)

2025-04-10

ClusterControl v2.3.2

clustercontrol2-2.3.2-1949
clustercontrol-controller-2.3.2-12518
clustecontrol-cloud-2.3.2-423
clustercontrol-clud-2.3.2-423
clustercontrol-ssh-2.3.2-213
clustercontrol-notifications-2.3.2-373
s9s-tools 1.9.2025041017-release1 

===

Welcome to the April release of ClusterControl v2.3.2. This update adds support for the latest major versions of PostgreSQL, Percona XtraDB Cluster, and support for enterprise binaries with XtraDB Cluster Pro.

In addition a technical preview is being prepared with CC Ops-C to support databases in Kubernetes, starting with PostgreSQL and MySQL replication clusters using community based database operators with YAML-based management and UI integration.

The K8s database operator will be supported with an upcoming release of CC Ops-C / MCC in the next few weeks.

* New Major Versions
These updates ensure compatibility with the newest features, performance improvements, and security enhancements offered by the respective database vendors.

• PostgreSQL 17
• Percona XtraDB Cluster 8.4

* Enterprise Binaries

• Percona XtraDB Cluster 8.4 Pro

* Kiosk / fullscreen dashboards for CCv2

• Watch set of metrics and setup your favourite watch list(s)

==== 

2025-04-01
clustercontrol-controller-2.3.1-12427
 

CMON Controller

• Address an issue with persisting ACL permissions after restarting CMON (CLUS-5704)
• Address an issue with mariabackup on Rocky 9 (CLUS-5671)

2025-03-26
clustercontrol-controller-2.3.1-12377
 

CMON Controller

• Address an issue when importing cmon_data.sql with MySQL 8.4.x. Removed erroneous comment line (CLUS-5694)
• Address an issue with Redis/Valkey Prometheus exporter’s systemd file which connected to sentinel nodes (CLUS-5691)
• Address additional improvements for supporting transactional cmon configuration write operations (CLUS-5667)
• Address an issue with MySQL binary log backup using deprecated SHOW MASTER STATUS (CLUS-5586)
• Address an issue with ProxySQL 2.x deployments not being supported with Ubuntu 24.04 LTS (CLUS-5561)

2025-03-25
clustercontrol-controller-2.3.1-12338
 

CMON Controller

•  
  • Address an issue with CMON segfault for MySQL Replication when restoring a backup with mysqldump (CLUS-5683)
  • Address an issue with HAProxy and using a deprecated / old 'mysqlchk' script with MySQL Oracle 8.4 or Percona Server/Percona XtraDB Cluster 8.4 (CLUS-5627)

2025-03-24
clustercontrol-controller-2.3.1-12316
clustercontrol2-2.3.1-1921
s9s-tools_1.9.2025032417 

CMON Controller

•  

  • Address an issue when upgrading PostgreSQL to preserve added custom configuration parameters (CLUS-5559)
    
    A new CLI parameter is available 'preserve-configuration'

  s9s cluster \
      --upgrade-cluster \
      --cluster-id=1 \
      --upgrade-to-version="15" \
      --upgrade-method="link" \
      --preserve-configuration \
      --log \
      --print-request

• Address an improvement to support for excluding tables with backup schedules (CLUS-5187)
• Address additional improvements to allow exclude tables with backup schedules (CLUS- 5187)
• Address an issue with an incorrect raised disk space alarm (CLUS-5569)
• Address an issue with ProxySQL where the hostname/FQDN is replaced with an IP address after failover (CLUS-5625)
• Address an issue with MongoDB backups is not taking backup title into account (CLUS-5632)
• Address an issue when removing a cluster that is not reachable taking several minutes to complete (CLUS-5611)
• Address an issue with create cluster from backup with Percona XtraDB (CLUS-5602)
• Address an issue applying Redis config changes (CCX, CLUS-5556)

UI

• Address an issue when all tags were not shown properly when hovering over the tooltip (CLUS-5662)
• Address an issue with PostgreSQL Logical cluster navigation of the sub-clusters (CLUS-5622)
• Address an issue with the visibility that a replica is delayed (CLUS-5364)
• Address additional improvements to allow exclude tables with backup schedules (CLUS-5639)

2025-03-19
 

clustercontrol2-2.3.1-1915

UI

• Address an issue where Exec time was always 0 in Query Monitor->Top Query (CLUS-5630)
• Address an issue when using hostnames with ProxySQL deployments failed (CLUS-5629)
• Address an issue where 'REPLICA MONITOR' was missing in the suggestion list (CLUS-1882)
  • Note that this field is editable, i.e., a user can enter any privilege that might come up in the suggestion list
• CLONE CLUSTER is deprecated with Galera clusters. Use create cluster from backup instead (CLUS-5600)
• Address an issue with test mail toaster showing incorrect information and/or overlapping (CLUS-5520, CLUS-5521)
• Address a cosmetic issue when selecting folder for Certificates management (CLUS-5518)
• Address an issue with the deployment preview step showing incorrect information with 'Disable firewall and Apparmor/SELinux' (CLUS-5542)
• Address an issue where when removing clusters from the cluster list with the removed cluster not updating its status correctly (CLUS-5369)
• Address an issue with a tooltip typo with the 'Create subscription' page (CLUS-5549)

2025-03-10
 

clustercontrol-controller-2.3.1-12185

CMON Controller

• Galera: CLONE CLUSTER is deprecated! Use 'Create cluster from backup'.
• Address additional improvements with transactional CMON configuration file write operations (CLUS-3846)
• Address an issue with no alarms being raised when a publication / subscription link is broken (CLUS-5541)
• Address an issue with Valkey 8 used the wrong placeholder for TLS settings (CLUS-5581)

========================

2025-02-20

ClusterControl v2.3.1

clustercontrol2-2.3.1-1877
clustercontrol-controller-2.3.1-12052
clustecontrol-cloud-2.3.1-422
clustercontrol-clud-2.3.1-422
clustercontrol-ssh-2.3.1-212
clustercontrol-notifications-2.3.1-372
s9s-tools 1.9.2025022018-release1 

===

Welcome to the February release of ClusterControl v2.3.1. This update introduces new features primarily for PostgreSQL and Valkey:

Support for PostgreSQL bi-directional logical replication

• Supported with PostgreSQL version 16.
  • PostgreSQL bi-directional replication allows multiple database instances to independently handle read and write operations. Changes made on any node are synchronized with other participating nodes, ensuring that data is eventually consistent across the system. This setup enables multiple-way synchronization, allowing each node to act as both a sender and recipient of update. The system operates asynchronously, meaning changes may not be instantly reflected across all nodes but will synchronize over time. This replication method enhances high availability, allowing nodes to continue processing requests even if others fail, minimizing downtime. It is particularly useful for geographically distributed databases, as each region can handle its own updates and synchronize with others.

  • Deploy a new PostgreSQL logical replication cluster

    • Easily set up and configure PostgreSQL logical replication clusters from scratch.

  • Setup/configure PostgreSQL logical replication between two existing PostgreSQL clusters

    • Seamlessly establish logical replication between two existing PostgreSQL clusters.

  • Publications and subscriptions management

    • Manage publications and subscriptions to control which data is replicated and to which nodes.

    • Alarms when publication / subscription link is disabled / broken.

• Valkey Sentinel

  • Valkey Sentinel is an alternative to Redis Sentinel which a high-availability (HA) tool that comes as part of Redis, designed to monitor Redis instances, automatically handle failovers, and provide notifications about the system’s health. It’s a key component for deploying Redis in environments requiring redundancy and resilience.

  • Use Valkey Sentinel 8.0 with the same feature set that we support for Redis Sentinel.

• Misc

  • New Cluster Load overview dashboards for Redis, Valkey and MongoDB

===========

2025-02-11
 

clustercontrol-controller-2.3.0-11958

CMON Controller

• Address an issue with failing importing MongoDB (CLUS-5444, CLUS-5425, CLUS-5179)
• Address an issue with grants when deploying ProxySQL (CLUS-5443, CLUS-5420, CLUS-5457)
• Address improvements with Cluster and Node recovery state sometimes being OFF for no reason (CLUS-5019)
• Address improvements when dropping a MySQL database/schema (CLUS-5242)
• Address improvements when removing a MySQL node (CLUS-5402)
• Address additional improvements with transactional CMON configuration file write operations (CLUS-3846)
• Address improvements to avoid race conditions when performing full backups (mysql) (CLUS-4946)
• Address an issue importing Valkey Sentinel on Rocky 9 with certificates failed to be copied (CLUS-5264)

2025-02-06
 

clustercontrol-controller-2.3.0-11913
clustercontrol2-2.3.0-1850

CMON Controller

• Address an issue with new deployment while in the 'Community Edition' (CLUS-5363, CLUS-5398)
• Address an improvement when writing/saving CMON configuration files to make the operation transactional (CLUS-3846)
• Address an issue when deploying or promoting a delayed replica with Percona Server (CLUS-5225, CLUS-5224)
• Address an issue with Valkey 7 and the remirepo which is no longer supported. Support matrix updated. (CLUS-5317)
• Address an improvement with error messages when deploying Valkey on Ubuntu (CLUS-5283)

UI

• Address an issue with pg_basebackup and PITR enabled backups showing up as PITR=no (CLUS-5318)
• Address an issue where the pagination value could not be changed from 20 pages (CLUS-5308)
• Address an issue with the HAProxy dashboard where the 'Role’ column is left blank (CLUS-5196)
• Address additional issues with the MongoDB dashboards when the replicaset names are the same (CLUS-5318)

2025-01-30
 

clustercontrol-controller-2.3.0-11838
clustercontrol2-2.3.0-1833 

CMON Controller

• Address a regression when trying to open system logs (CLUS-5334)
• Address an issue to add MySQL 8.4 to Group Replication support matrix (CLUS-5314)
• Address an issue with ProxySQL node status showing up as failed even though being operational (CLUS-5254)
• Address an improvement (race condition) when restoring a Redis backup randomly fails (CLUS-2958)
• Address an issue with Redis Sentinel backup verification where a incorrect config file was used (CLUS-5278)
• Address an issue with node reboot on CloudStack (CLUS-5285)
• Address improvements for license expiration messages (CLUS-3184) 

UI

• Address an issue with MongoDB replicaset clusters where the dashboard was showing information from other clusters (CLUS-5318)
• Address an issue with the Cluster Overview dashboard listing keepalived nodes in an incorrect location (CLUS-5353)
• Address an issue when selecting 'Auto' when creating a backup scheduled always choose the primary instead of the replica node as backup host (CLUS-5299, CLUS-5335)

2025-01-08
 

clustercontrol-controller-2.3.0-11678
clustercontrol2-2.3.0-1788 

CMON Controller

• Address an issue where Redis Sentinel log files were not returned correctly (CLUS-5219)
• Address an issue with 'Do not setup vendor repository' where a vendor repo was still used (CLUS-5099)
• Address an issue with Valkey deployments on Ubuntu distros (CLUS-5207)
• Address an issue with Valkey deployments on Rocky/Alma/RHEL9 (CLUS-5236)
• Address an issue with MS SQL Server and full backups when the schema has a hyphen in its name (CLUS-5227)

UI

• Address additional issues with Top Queries page and sorting columns (CLUS-4973)
• Address an issue with the cluster list when 'Cluster to Cluster’ clusters are listed (CLUS-5171)
• Address an improvement adding back 'Create Database/Schema' from the UI (CLUS-4824)
• Address improvements to the tooltips for the 'Cluster Load' page (CLUS-5194)
• Address an issue with MongoDB deployments when using 'internal/private IP/hostnames' (CLUS-5222)
• Address an issue with an empty Primary node on the dashboard when deploying multi-primary + replica MariaDB cluster (CLUS-5191)
• Address an issue when editing a backup schedule with excluded tables (CLUS-4984)

2024-12-12
 

clustercontrol-controller-2.3.0-11519

• Address an issue with Valkey 8 deployment on DigitialOcean and 'Transparent Huge Pages' (CLUS-5183)
• Address an issue with MySQL configuration and using true/false instead of ON/OFF (CLUS-5204)
• Address an issue with MySQL backups with ownership change of the backup directory recursively (CLUS-5192, CLUS-4102)
• Address an issue with Percona Pro deployment where the clientID and token were switched (CLUS-4386)
• Address an issue with the MySQL slow query parser and logging failed queries (CLUS-5168)
• Address an issue with potential race conditions when taking full backups (CLUS-4946)
• Address an issue with PostgreSQL configuration changes to use ’ALTER SYSTEM SET’ (CLUS-5111)
• Address an issue with the Prometheus configuration file not being updated correctly when a node is removed (CLUS-5040)
• Address an issue with CMON segfault on Debian 12 when deploying a MongoDB replicaset cluster (CLUS-5179)

2024-12-12
 

clustercontrol-controller-2.2.0-11528

• Address an issue with MySQL configuration and using true/false instead of ON/OFF (CLUS-5204)
• Address an issue with PostgreSQL configuration changes to use ’ALTER SYSTEM SET’ (CLUS-5111)

==============================

ClusterControl v2.3.0

2024-11-25
clustercontrol2-2.3.0-1734
clustercontrol-controller-2.3.0-11297
clustecontrol-cloud-2.3.0-419
clustercontrol-clud-2.3.0-419
clustercontrol-ssh-2.3.0-209
clustercontrol-notifications-2.3.0-369
s9s-tools-1.9.2024112518-release1 

===

Welcome to the November release of ClusterControl v2.3.0. This update includes support for new long-term support (LTS) version of MySQL 8.4, Valkey 8.0 and Elasticsearch 8.15. Additionally, a new Enterprise Binaries option for Percona Server Pro has been introduced, offering FIPS-140-2 compliance.

We are also bringing back an old favourite from the legacy CCv1 UI which is the Cluster Load and Overview dashboard for MySQL Replication, Galera and PostgreSQL.

Key features include:

• Support for MySQL 8.4 - Vendors: Percona Server for MySQL 8.4 and Oracle MySQL 8.4 LTS
  MySQL 8.4 LTS brings significant improvements in performance, scalability, security, and usability. It enhances query optimization, InnoDB performance, and partitioning for faster processing of complex queries and large datasets. Security has been boosted with better Transparent Data Encryption (TDE), improved password policies, and multi-factor authentication. Group Replication and binary log compression enhance high availability and replication efficiency. JSON support has been expanded with more functions, making it easier to handle JSON data, and the Document Store provides stronger NoSQL capabilities. The optimizer now includes hash joins, invisible indexes, and improved histogram statistics for better query performance. Developer features like Common Table Expressions (CTEs) and extended window functions make writing complex queries easier. Geo-spatial features are enhanced with improved spatial indexing and point-in-polygon functionality. Resource groups and enhanced monitoring tools allow for better resource allocation and easier performance troubleshooting. Overall, MySQL 8.4 LTS focuses on delivering better performance, security, and cloud compatibility for modern applications.
   
• Support for Elasticsearch 8.15
  Elasticsearch 8.15 introduces several key updates and optimizations. It introduces LogsDB in tech preview, which reduces storage needs by up to 2.5 times, making log handling more efficient. Vector search enhancements include int4 quantization, which cuts memory usage by up to eight times, and adds support for bit vectors with Hamming distance for better similarity searches. Semantic search improvements simplify using machine learning models for vector generation and provide seamless integration with providers like Google Vertex AI and Amazon Bedrock. Learning to Rank and Query Rules are now generally available, enabling more fine-tuned relevance adjustments. Geospatial search adds the ST_DISTANCE function to ES|QL for better spatial queries. Further alignment with OpenTelemetry includes support for native OTLP profiling. Security features focus on AI-driven SIEM analytics and automated data onboarding, simplifying security tasks. Cross-cluster search (CCS) and ES|QL see improvements, enhancing distributed search capabilities. SIMD optimizations enhance vector search performance, particularly for ARM and x64 architectures. Lastly, the Elastic AI Assistant now supports expanded model integration for generative AI and automated decision-making.
   
• Support for Valkey 8.0 - for RHEL/Rocky/AlmaLinux 9
  A big focus in Valkey 8.0 development was on achieving better performance with an expressed goal of being able to deliver one million requests per second and unlocking more CPU potential from this in-memory data store. There's been many optimizations and tripling the speed over the former Redis open-source code. There are also very nice memory efficiency improvements with Valkey 8.0. Some of the Valkey 8.0 specifics include optimizing the handling of temporary set objects in SUNION and SDIFF for 27~41% better performance, experimental RDMA user keep-alive support, improving multi-threaded performance with memory prefetching, various command changes, new cluster features, dual channel efficient full-sync replication, async I/O threading for better multi-threaded performance, optimized CPU cache efficiency, reliability improvements, and much more
• Enterprise Binaries
  • Support for Percona Server Pro (Subscription) packages
  • FIPS-140-2 compliance with Percona Pro
     
• CCv2 UI
  • Cluster Load and Overview dashboard: MySQL Replication, Galera and PostgreSQL
  • Print chart or export to PDF
  • UI diagnostic (troubleshooting) tool
  • Product tour to onboarding new users
    • Tours: Deployment, Activity Center (jobs), Cluster list and overview, Backup schedule

    • The product tour can be disabled by setting a parameter in the <webroot>/clustercontrol2/cconfig.js file:

      ONBOARDING_ENABLED: false

• Misc
  • New theme and branding
  • Easy access (link) to our changelog documentation

========================================================================

2024-11-25
 

clustercontrol-controller-2.2.0-11297

• Address an issue with MaxScale and missing dependency with 'killall' (CLUS-5095)
• Address an issue with PostgreSQL when adding a replica node where the memory configuration was taken from the primary node’s host and not the replica’s (CLUS-5104)
• Address an issue where a failover job is marked as even though the failover was deemed unnecessary CLUS-5068)
• Address an improvement with PostgreSQL to increase 2048 by default (CLUS-5054)
• Address an issue with the default setup for SSL/TLS and CCX (CLUS-5077)
• Address an issue where cloud only backups are not purged correctly from local storage for CCX (CLUS-3709)
• Address an issue with MSSQL and users not being replicated when adding a new replica node (CLUS-4996)
• Address an issue with MySQL Replication where 'delete after upload' breaks incremental backup grouping (CLUS-4198)

2024-11-08
 

clustercontrol2-2.2.5-1712

• Address an issue with sorting columns in the Top Queries view (CLUS-5030)
• Address an issue with pagination on the nodes page (CLUS-4964)

2024-11-05
 

clustercontrol2-2.2.5-1699

• Address a regression with 'ilert' (service config test) as a vendor option with the notification services (CLUS-5030)
• Address an issue with slow queries pagination (CLUS-4962)
• Address an issue with an incorrect confirmation dialog when adding an Elastic snapshot repo (CLUS-4662)

2024-10-31
 

clustercontrol-controller-2.2.0-10973
clustercontrol-controller-2.1.0-10970

• Address an issue with MaxScale when deploying & importing from RockyLinux 8/9, AlmaLinux 8/9 and RHEL 8/9 (CLUS-4929)

2024-10-24
clustercontrol-controller-2.2.0-10916
 

• Address an improvement to allow disabling database growth analytics with this new CMON conf parameter `database_growth_enabled=false`  (CLUS-4670)
• Address an issue to disable Percona’s telemetry agent by default (v8.0 and upcoming v8.4) (CLUS-4925)
• Address an issue importing a Galera cluster when there is no schema (CLUS-4364)

2024-10-09
clustercontrol2-2.2.5-1655
clustercontrol-notifications-2.2.5-364

• Address an improvement to add 'ilert' as a vendor option with the notification services (CLUS-4869, CLUS-4908) 

2024-10-03
clustercontrol2-2.2.5-1647

• Remove dependency of the clustercontrol-proxy package for the clustercontrol2 package

2024-10-02
clustercontrol-controller-2.2.0-10707 clustercontrol2-2.2.5-1642

• Address an issue to set 'safety backup' when doing a backup restore to be disabled by default with all database types (CLUS-4840)
• Address an issue when doing PITR using a deprecated / removed variable 'skip-gtids' with MariaDB (CLUS-4870)
• Address an issue with database growth running every 1h to every 12h (CLUS-4670)
• Address an issue when querying for runtime variables with PostgreSQL (CLUS-4832)
• Address an improvement to deploy with local mirrored repository (CLUS-4621)
• Address an improvement to use systemd for starting, stopping and restarting MongoDB (CLUS-4337)
• Address an issue to support insecure S3 uploads (CLUS-4763)
• Address an issue to support 'Create new local repository' with CCv2 UI (CLUS-4345)
• Address an issue to obfuscate plain text password in the job specification (CLUS-3495)
• Address a few minor cosmetic issues with the User registration form (CLUS-4557)
• Address an issue with Galera Overview dashboard where the cluster size was incorrect when there was a split brain issue (CLUS-4787)
• Address a cosmetic issue with the deployment wizard for PostgreSQL when using pg_vector (CLUS-4736)
• Address an issue with 'PostgreSQL Overview' dashboard with TimescaleDB deployments (CLUS-4859)

2024-09-23
clustercontrol-controller-2.2.0-10600

CMON Controller

• Address additional issues with mysqldump and database names with '_' in their names  (CLUS-4647)
• Address a regression with PITR for MariaDB/MySQL where binary logs were applied from the beginning regardless of when the full backup was taken (CLUS-4806, CLUS-4795)
• Address an race condition issue with the pbm agent script when started by several CMON threads (CLUS-4648)
• Address an improvement for local repositories (CLUS-4624, CLUS-4621) - NOTE a UI update will arrive later
• Address an issue with 's9s cli’ where cloud credentials were exposed to non admin users (CLUS-4784)
• Address an issue to update the 1.9.5 CMON API docs to 2.2.0 (CLUS-4771)
• Address an issue to remove duplicate and obsolete operational reports (CLUS-2417)
• Address an issue with charts/graphs not showing up properly with operational reports (CLUS-4143, CLUS-2417)
• Address an improvement to make WAL archiving default with pg_basebackup (CLUS-4768, CLUS-4572)

2024-09-17
clustercontrol2-2.2.5-1615

Web App

• Address an issue with Dashboard node dropdown when switching between clusters (CLUS-4696)
• Address an issue with incorrect MaxScale port showing in the nodes pages (CLUS-4678)
• Address an issue where the Time value is always 0 with the Query Monitor -> DB Connections for MySQL (CLUS-4663)
• Address an issue with an incorrect color selection for load balancers in the 'Add load balancer' wizard (CLUS-4668)
• Address an issue with the 'Rebuild Replica' dialog loading spinner being stuck for PostgreSQL (CLUS-4785)

2024-09-13
clustercontrol-controller-2.2.0-10461 clustercontrol-controller-2.1.0-10462

CMON Controller

• Address a regression with 'show global status' when there is no Prometheus node available (CLUS-4767, CLUS-4770)
• Address an issue with mysqldump and database names with dot in their names when using UCS2 encoding (CLUS-4647)
• Git HASH is now included with `cmon —version` (CLUS-4658)
   

=====================================================================

ClusterControl v2.2.0

2024-09-11
clustercontrol2-2.2.5-1603
clustercontrol-proxy-2.2.4-42
clustercontrol-controller-2.2.0-10417
clustecontrol-cloud-2.2.5-413
clustercontrol-clud-2.2.5-413
clustercontrol-ssh-2.2.5-201
clustercontrol-notifications-2.2.5-360
s9s-tools-1.9.2024082802-release1

===

Welcome to the September release of ClusterControl v2.2.0. This update includes support for a Valkey which is a Redis compliant open source (BSD) high-performance key/value datastore, MariaDB 11.4 LTS and Ubuntu 24.04 LTS.

Key features include:

• Support for Valkey 7.2.5 - Valkey
  • Valkey is an open source (BSD) high-performance key/value datastore that supports a variety of workloads such as caching, message queues, and can act as a primary database. Valkey can run as either a standalone daemon or in a cluster, with options for replication and high availability.
  • Limitations
    • Only supported for RPM based distros (for example RockyLinux 8 or 9)

• Support for MariaDB 11.4 LTS - MariaDB Community Server 11.4 LTS: What This Means For Customers | MariaDB
  • MariaDB Community Server 11.4 will be a long-term maintenance (LTS) release. Version 11.4 will be the first release of the 11.x series to be LTS. This means that we will provide five years of bug fixes for this release once it’s GA.
  • Release notes - Changes and Improvements in MariaDB 11.4

• Support for Ubuntu 24.04 LTS Noble Numbat) - Canonical releases Ubuntu 24.04 LTS Noble Numbat | Canonical
  • Ubuntu 24.04 LTS will be the first LTS to enjoy a whopping 12 years of support. Usually, LTS releases get five years of security and maintenance updates with an additional five years of extended security support, making a total of 10 years of support before reaching EOL (End-Of-Life).

• Redis Cluster
  • Added additional backup options
    • Compression, encryption, and verify backup

• MongoDB Improvements
  • `shardsvr` removed from Replicaset setups

• HAProxy Improvements
  • Support for monitoring (alerts) HAProxy node health (operational status)

• Vault Integration Improvements
  • This addresses a limitation of the Vault integration with the CMON controller where ‘cmon-events’ still need credentials in the /etc/cmon.cnf file
  • The ‘cmon-events’ process now supports Vault integration and thus the /etc/cmon.cnf file is no longer required

# /etc/cmon-events.cnf
vault_token = hvs.A2j7ScVH2j7qC8CAQni7sJ31
vault_addr = http://127.0.0.1:8200
vault_secret_path = 4efbf326-7087-47d7-9200-6c4a135494af/cluster_0

• Support for FIPS-140-2
  • Correctly signed ClusterControl packages with SHA-256
  • Linking CMON Controller with OpenSSL 3.0.x library

• Elasticsearch Improvements
  • Support for importing Elasticsearch 7.x and 8.x clusters

• ClusterControl Ops-C Improvements (Multiple Controllers support)
  • Added support of using ‘cmon-proxy’ to serve requests for the CC Ops-C web application.
    The Apache server is no longer required and can be completely uninstalled.

$ apt update
$ apt purge apache2 # purge the Apache server since it's no longer required
$ apt purge clustercontrol2 # purge CCv2 web U since it is no longer required
# install clustercontrol-cc
$ apt install clustercontrol-mcc
# register the local CMON controller with cmon-proxy
$ ccmgradm init --local-cmon -p 443 -f /var/www/html/clustercontrol-mcc # serve web application on port 443
$ systemctl restart cmon-proxy
# change TLS cert if needed in /usr/share/ccmgr/ccmgr.yaml and restart cmon-proxy
$ cat /etc/share/ccmgr/ccmgr.yaml
filename: /usr/share/ccmgr/ccmgr.yaml
webapproot: /var/www
fetch_jobs_hours: 12
fetch_backups_days: 7
instances:
- xid: cqf1b1cfnetrgl51vhrg
url: 127.0.0.1:9501
name: local
use_cmon_auth: true
frontend_url: localhost
cmon_ssh_host: 127.0.0.1:9511
timeout: 30
logfile: /var/log/ccmgr.log
users:
- username: admin
passwordhash: fa31fa6e142d9d1b:6870:21790d5c340c9fe207d6a5e29fe39eaddeff200b517e90e19318dddb515a424f
frontend_path: /var/www/html/clustercontrol-mcc
port: 443
tls_cert: /usr/share/ccmgr/server.crt
tls_key: /usr/share/ccmgr/server.key
session_ttl: 1800000000000

# open ClusterControl Ops-C at https://<cmon controller ip>:443 and logon with one of your existing CC admin user
User registration form has been added when using CC Ops-C with a single local CMON controller.

• CCv2 UI (clustercontrol2 package)
  • Support for showing redundant indexes for MySQL
  • Support for using Apache mod_php with the Apache server instead of using mod_proxy
    • Install php (and remove mod_proxy)
    • Copy the Apache configuration from /usr/share/cmon/apache/cc-frontend.conf to /etc/httpd/conf.d/cc-webapp.conf (as an example)
    • In the Apache configuration comment the IncludeOptional /usr/share/cmon/apache/cc-frontend-cmon-api.conf and IncludeOptional /usr/share/cmon/apache/cc-frontend-license.conf
    • Uncomment either IncludeOptional /usr/share/cmon/apache/cc-frontend-php-proxy-socket.conf or IncludeOptional /usr/share/cmon/apache/cc-frontend-php-proxy-curl.conf (second requires php curl module)
  • The Apache configuration are now stored for RPM based distros as /usr/share/cmon/apache/cc-frontend.conf when the clustercontrol2 package is installed manually.
  • The cc-proxy.conf Apache configuration file is not longer required and is not part of the clustercontrol2 package any longer
  • After upgrading from 2.1.0 or older version of the clustercontrol2 package the Apache configuration file cc-frontend.conf (if it exists) will be renamed to cc-webapp.conf

======================================================================================================================================================

In this release we have prioritized improving our high availability setup (CMON HA) for ClusterControl. It is an active/passive solution using the Raft protocol between a CMON controller 'leader' and 'followers'.

A CMON controller is the main process in ClusterControl and it's the 'control plane' to manage and monitor the databases.

To use CMON HA, you will basically need to do the following:

• Use a shared MySQL database cluster that all CMON controllers will use as the shared storage.
  Our recommendation is to use a MySQL Galera cluster which provides additonal high availability of the database cluster.
   
• Install several ClusterControl nodes, at minimum 3 nodes for the quorum / voting process to work.
   
• These should be setup to connect / share the same CMON database and also have identical rpc_key (cmon.cnf) and RPC_TOKEN (bootstrap.php) secrets.Add the IP of the host of the Controller node to the RPC_BIND_ADDRESSES parameter in the /etc/default/cmon file on all CMON nodes.
   

• Next enable CMON HA using the s9s CLI on one of the CMON controller nodes.
  On the selected 'leader' CMON controller node enable CMON HA using the s9s CLI.

  s9s controller —enable-cmon-ha

• Restart the other CMON controller 'follower' nodes.

  systemctl restart cmon

• Verify that you have a leader and few followers using the s9s CLI

  s9s controller —list —long

Finally in order to setup the web application to handle ‘leader' failures transparently we can use a load balancer like HAProxy which will failover to a 'leader' node which provides the 'main/active’ web application. This involves installation of HAProxy, configure it to health check the CMON nodes which can be achieved with a combination of using xinetd and a custom script to call on the CMON RPC API interface.

Please see the online documentation on CMON HA for a more detailed setup instructions.