We have encountered a severe bug in a library used by ClusterControl 1.7.3. This bug affects SSH communication and may cause severe side effects. If you are using ClusterControl 1.7.3 then you must upgrade the clustercontrol-controller package to version 1.7.3-3440 or later.
Note: Replication lag alarms are sent from version 1.7.6 and onwards. In earlier versions, replication lag alarms were not always properly raised. If you notice replication lag alarms, you may increase the 'MAX REPLICATION LAG' configuration variable or tune replication and queries.
Note: Cluster 2 cluster replication using PXC requires that server_id and binlog settings are identical on all nodes of the slave cluster. Read more here.
2021-03-02 clustercontrol-1.8.1-7660, clustercontrol-controller-1.8.1-4392
Frontend:
- Topology View: Added maintenance mode visualization support in the topology view.
- LDAP: Fixed an issue where the default user's timezone has changed after upgrading to ClusterControl 1.8.1.
Controller:
- MaxScale: Fixed a dependency issue with libcurl3 for older Ubuntus.
- PgBackrest: Fixed an issue where installing PgBackrest failed with "check command requires option: pg1-path".
2021-02-23 clustercontrol-1.8.1-7639, clustercontrol-controller-1.8.1-4383
Frontend:
- Backup: Improved field validation for the cron settings.
- Jobs: A scheduled backups job displayed the current time instead of schedule time in the job title.
- MySQL: Kill connection did not function due to an issue with host ids.
Controller:
- MaxScale: Updated to version 2.5.7.
- MySQL: Kill connection did not function due to an issue with host ids.
- Percona XtraDb Cluster: Fixed an issue preventing deployment of 8.0 on Debian 10 (Buster).
- Logging: Improved logging of dead connections.
2021-02-11 clustercontrol-1.8.1-7621, clustercontrol-controller-1.8.1-4369
Frontend:
- Security: Fixed an issue to redirect the user to the login page when a request was blackholed after a session timeout.
Controller:
- MySQL 8.0: Added support for new privileges added in MySQL 8.0.23.
- Systemd scripts for CMON.
2021-02-08 clustercontrol-1.8.1-7605, clustercontrol-controller-1.8.1-4362
Frontend:
- Query Monitor: Show the time on the 'Running Queries' page in a more user-friendly format.
Controller:
- MySQL 8.0: Fixed a bug when an ALTER USER command to change the db user password was issued when using the 'caching_sha2_password' plugin.
- ProxySQL: Updating the admin user/password did not update the cluster admin/password when ProxySQL Clustering is enabled.
- Logging: Fixed a bug regarding the log message. A log message from the watchdog thread was printed out using the wrong timezone.
- PostgreSQL & HAProxy: The postgresql checker script was configured with the wrong password on the slave nodes.
2021-01-22 clustercontrol-1.8.1-7559
- Azure integration: Fixed an issue related to the selection of subnets.
- Backup. Added an option to Skip the md5sum check for a backup job. Md5sum checks may take a long time on large backup files.
- Backup: Fixed an issue where the wrong warning was printed in the Restore Backup section when the option "Restore To Standalone Node" was selected.
- Backup Feature: Rerun failed scheduled backup jobs from the Jobs view.
2021-01-21 clustercontrol-controller-1.8.1-4343
- Backup: Make it optional to skip the md5sum check for a backup job. The m5sum may take a long time to execute on large backups. This can be configured by setting backup_create_hash in the UI (Settings -> Runtime Configuration, no restart needed), or set backup_create_hash in /etc/cmon.d/cmon_X.cnf (where X is the cluster id) and restart cmon.
- Percona XtraDb Cluster 8.0: Failed deploy on Ubuntu 20.04 and fixes to certificate creation.
2021-01-13 clustercontrol-controller-1.8.1-4327
- Fixed a bug where netcat_ports used by backup could collide with ports used by e.g Prometheus exporters and services.
- MongoDb Backup: Check free space on storage host before starting backup.
- CPU Usage Alarm: Made it configurable how long time CPU Usage should be above a Warning/Critical threshold before raising the alarm. This can be set in the cmon configuration file (host_stats_window_size) or from the CMON Settings in the frontend and S9S CLI.
2021-01-07 clustercontrol-1.8.1-7527
- MySQL root password is now correctly set when using the cloud deployment (wizard)
- The MySQL verify backup job is now containing the entered PITR position or time
- The backups page was missing the 'backed up tables info' for MySQL partial backups with tables
2020-12-30 clustercontrol-controller-1.8.1-4314
- Percona Backup for MongoDB: The controller always reports the backup failed, but PBM says the backup completed and there are no error logs.
2020-12-28 clustercontrol-controller-1.8.1-4311
- MySQL Replication: Fixed a bug regarding package dependencies when adding a replication slave using Oracle MySQL 8.0 on CentOS/RHEL 8.
2020-12-23 clustercontrol-controller-1.8.1-4304
- MariaDB: Adding 'module_hotfixes=1' to repo files to overcome the MariaDB issue https://jira.mariadb.org/browse/MDEV-20673
2020-12-18 clustercontrol-controller-1.8.1-4299
- Verify Backup: Fixed an issue where the Verify Backup would fail on MariaDb 10.2 and later if the MariaDb version of the restore host could not be determined. The error presented itself as "/usr/bin/mariabackup: unknown option '--apply-log-only'"
2020-12-14 clustercontrol-controller-1.8.1-4294
- ProxySQL: Deployment fails because of a weak proxydemo user password. Now the proxydemo user is not created at all.
2020-12-11 clustercontrol-controller-1.8.1-4292
- Verify Backup: The Verify Backkup job failed for MySQL based system because the Backup Verification Server was in read-only mode.
- Verify Backup: When verifying 'mysqldumps' the binary logs of the Backup Verification Server were not removed.
2020-12-10 clustercontrol-1.8.1-7500
- Remove duplicate headers in 'Query Monitor'
2020-12-09 clustercontrol-controller-1.8.1-4285
- PostgreSQL: Can't remove PostgreSQL slave in case of co-location.
- MariaDb: Fixed a bug with Backup Verification doesn't work on MariaDB 10.2 and later (--apply-log-only is not supported any longer).
- MongoDb: mongodump logging improvement to add the last 50 lines of its output to the backup job log.
2020-12-05 clustercontrol-1.8.1-7491
- Fix for ClusterControl user login. The login username was required to be an email address which prevented LDAP login with a plain username.
2020-11-30 clustercontrol-controller-1.8.1-4274
- MongoDb Percona Backup: Fixed an issue when deleting a backup. The deletion was reported as successful, but it actually failed.
- MySQL Replication: Fixed a bug where the read_only setting in my.cnf could be inconsistently set on the nodes. The my.cnf file must always have read_only=ON on all nodes.
- MySQL Replication: Fixed an issue where if the auto_manage_readonly = true , then a user could set read_only = OFF on a slave. Now the read_only flag will be set to read_only = ON as soon as it is detected.
- Backups: Fixed the job title of backups executed from schedules. Before the title was set to 'Backup schedule #N'N, where NN is a number. Now the backup title is properly set to 'Create Backup'
2020-11-23 clustercontrol-1.8.1-7473
- Backup->Settings->Backup Settings: Customize/set netcat ports to use when streaming backups
- Cluster 2 Cluster: 2nd PostgreSQL slave cluster is now properly linked
- Delete Job: Add back support to delete pending jobs via the Activity Viewer
- Restore PITR backup: Correctly set/select the node to restore the backup (PITR) on
- Import Cluster: You no longer need to specify vendor or version - it's automatically detected
- Cluster Overview: Setting the same time range sometimes resulted in showing a different range
- Misc
- Fix incorrect backup restore confirmation messages
- Fix modal and sidebar issues with the restore backup dialog - it now closes properly
- Fix broken backup scheduler icon for the jobs in the Activity Viewer
- Fix overlapping text in the Logs->Jobs page for smaller screen resolutions
- Empty role is now not being created when cancelling the role creation
2020-11-18 clustercontrol-controller-1.8.1-4258
Controller:
- MongoDB: Installing PBM on mongodb.org release v4.2 failed.
- MaxScale: Due to an SSH environment problem a node transitioned between Offline/Online. Now there is better logging in this area.
- Scheduled backups: Fixed a bug where the scheduled backup printed out the same ID number (#0) for all backups. Note: It is only a printout/formatting issue.
ClusterControl v1.8.1 - 2020-11-13
clustercontrol-1.8.1-7442
clustercontrol-controller-1.8.1-4249
clustercontrol-notifications-1.8.1-261
clustercontrol-ssh-1.8.1-99
clustercontrol-cloud-1.8.1-263
In this release, we introduce a new consistent backup method for MongoBb Replica Sets and Sharded Clusters, native ProxySQL Clustering support, version updates of supported databases, PITR improvements for MySQL, and last but not least security enhancements on the web UI.
Security is always a top priority, and as a part of the security enhancements, a number of vulnerabilities were fixed in the web UI.
MongoDb 3.6 and later can now use Percona Backup For MongoDb to create consistent backups of replica sets and sharded clusters.
ProxySQL Clustering offers a convenient way to keep a number of ProxySQL servers in sync. If e.g a user is created on a node, then the change is propagated to other clustered ProxySQL nodes.
Let us know what you think about these features and changes anytime (Submit Feedback)!
Feature Details
MongoDb Backup
- Uses Percona Backup For MongoDb
- Backup and Restore Replica sets and Sharded Clusters
ProxySQL Clustering
- Leverage the built in clustering of ProxySQL to keep ProxySQL instances in sync
Version Updates
- Percona XtraDb Cluster 8.0
- MariaDb and MariaDb Cluster 10.5
Security Improvements
- Prevent Clickjacking
- Updated Jquery (3.5.0)
- CGI Generic Cross-Site Request Forgery Detection
MySQL PITR enhancements
- Backup a node and perform PITR on any node in the Cluster
ClusterControl v1.8.0
2020-11-04 clustercontrol-controller-1.8.0-4223
Controller:
- Prometheus: Fixed an issue where the port used by a Prometheus exporter was incremented and could be different on each node. This made it problematic to maintain e.g firewalls.
2020-11-03 clustercontrol-controller-1.8.0-4218
Controller:
- PostgreSQL: Add missing quoting of PostgreSQL passwords in cmon configuration file.
- Deployment fails for MariaDB 10.4 on CentOS 8.
- Deployment fails for MariaDB 10.3 on CentOS 8.
2020-10-29 clustercontrol-controller-1.8.0-4210
Controller:
- Prometheus: Fixed an issue where the port used by a Prometheus exporter was incremented and could be different on each node. This made it problematic to maintain e.g firewalls.
- Notifications: Improvements to the Memory/RAM usage alarm.
2020-10-26 clustercontrol-controller-1.8.0-4202
Controller:
- Alarms: Improved reporting on the memory-/RAM-usage alarms to include the actual bytes used and total bytes available.
- General: Optimized and reduced the CPU usage of the controller when using Prometheus.
- Keepalived: Fixed a bug when uninstalling Keepalived where the controller tried to copy a non-existing config file.
2020-10-16 clustercontrol-controller-1.8.0-4195
Controller:
- General: Fix some high CPU usage about Prometheus sampling with many clusters.
- Cloud Deployment: Use private/internal IPs to communicate with DB nodes when 'use_private_network' option is set.
- Deployment: Fixed an issue with Percona installation on Debian/Ubuntu. It was pulling -dbg packages and it prolonged the installation time.
2020-10-14 clustercontrol-1.8.0-7331 clustercontrol-controller-1.8.0-4190
Frontend
- Alarms: Refactored the alarms page to make it more space-efficient.
Controller:
- MariaDb Cluster 10.4 failed to deploy on Centos 8. As a side-effect, due to dependency issues, percona-toolkit can not be installed.
2020-10-13 clustercontrol-controller-1.8.0-4188
Controller:
- PostgreSQL: Change the owner of a pre-created datadir owned by another user than 'postgres'.
- Query Monitor: 'Last seen' was set to 'now' and not the actual 'last seen'.
2020-10-07 clustercontrol-1.8.0-7312 clustercontrol-controller-1.8.0-4181
Frontend
- Cloud Deploy: Added an option to use private IP address only when creating the VMs.
Controller:
- HAProxy: Failed to Enable/Disable HAProxy because node_address was not taken into account.
- Deployment: Improved logic to determine the AppStream repository name for CentOS/RHEL/Oracle.
- MySQL Cluster: include ndb_mgm -e show in the error-report.
2020-09-29 clustercontrol-controller-1.8.0-4166
Controller:
- MySQL Cluster: Fixed an issue when handling status replies of MySQL Clusters containing many nodes.
2020-09-29 clustercontrol-controller-1.8.0-4165
Controller:
- Improved error handling & logging (including error-reporting) for MySQL NDB Clusters.
- ProxySQL Galera: Fix for crash for when updating ProxySQL in case the host group does not exist or is not defined.
- PostgreSQL: Fixed an issue when deploying on CentOS/RedHat using the option "Do Not Setup Vendor Repositories" as it wrongly adding --repo=pgdg to the yum install command.
2020-09-23 clustercontrol-1.8.0-7277 clustercontrol-controller-1.8.0-4156 clustercontrol-cloud-1.8.0-254
Frontend
- ProxySQL: Top Queries page shows super-long non-truncated digest text.
- Cloud Deployment: Fixed an issue where the wrong unit (MB) was passed to the cmon-cloud service. GB was expected.
Controller:
- HAProxy: Fixed an issue to refresh/sample HAProxy on certain actions.
- MySQL Replication: Fixed an issue to allow removing down/failed master(s) in case when there is more than one node in the cluster.
- APT repository mirroring fixes (updated aptly and fixed gpg handling on newer systems) for Ubuntu 18.04.
Cloud:
- Azure: Fixed a timeout issue where it was not possible to get the status of a VM within 10m (Could not get VM statuses in 10m0s.)
2020-09-16
clustercontrol-1.8.0-7250
clustercontrol-controller-1.8.0-4145
clustercontrol-notifications-1.8.0-257
clustercontrol-cloud-1.8.0-252
clustercontrol-ssh-1.8.0-96
Feature Details
Scalability
- ClusterControl support hundreds of nodes.
- Lowered CPU consumption.
Vault Integration
- Credentials stored in cmon configuration files can now be moved to Vault.
Tagging
- Supported via the S9S CLI.
- Set tags to the existing clusters and on cluster creation.
- Filter by tags.
ClusterControl v1.7.6
2020-09-10 clustercontrol-1.7.6-7237
Frontend
- OpsGenie: Fixed a bug where the Integration could not be created due to '"Failed to parse request body:...'
- OpsGenie: Updated instructions. The API Key must be the API Key of the Team may be used: https://docs.opsgenie.com/docs/api-key-management .
- HAProxy: Fixed a bug where disable HAProxy failed because UI didn't send the hostname parameter to the job.
- MariaBackup: Fixed an issue with partial backups. It was not possible to specify databases/tables.
2020-09-08 clustercontrol-controller-1.7.6-4130
Controller:
-
Oracle/MySQL 8.0 compatibility & testing fixes.
2020-09-02 clustercontrol-1.7.6-7207 clustercontrol-controller-1.7.6-4120
Frontend
- Topology VIew: Fixed and issue to avoid flickering on cluster update.
- Topology View: Fixed an issue showing the topology for 3 or more multi-masters.
- ProxySQL: The IP/Hostname Address was truncated in ProxySQL Processlist.
Controller:
- MongoDb: Node menu does not appear for MongoDB Replicaset due to an internal error.
- MongoDb: Fixed a bug causing Mongo shard recovery to fail and Mongos are started last.
- Prometheus: Upgraded node_exporter to 1.0.1 (no incompatible changes) + some typo fixes.
- Prometheus:Bump Prometheus version to 2.20.1
- [improvement] OS Support: Updated compatibility matrix to support Ubuntu 20.04.
2020-08-27 clustercontrol-controller-1.7.6-4108
Controller:
- OS Detection: Fixed an error to be more tolerant to extra lines introduced by ssh login to a host. This caused an issue when detecting the operating system.
- Cmon Db Schema: Fixed an issue with the cmon_log_entries table that has an invalid Foreign Key.
- ProxySQL: deploy fails on Debian 10 in combination with Percona or Oracle/MySQL 8.0
- Fixed an issue on MySQL based system where the rebuild replication slave would fail when using uppercased hostnames.
2020-08-17 clustercontrol-1.7.6-7158 clustercontrol-controller-1.7.6-4083
Frontend
- Dashboards: Fixed an issue in the Replication dashboard where the Master Server ID was presented as a decimal value and not an integer.
Controller:
- ProxySQL: Fixed a bug with logs getting flooded with SAVE MYSQL SERVERS TO DISK /LOAD MYSQL... commands if there was a MySQL server not present in the ProxySQL Server's mysql_servers table.
- Alarms: Fixed a timezone problem between the reported date in the Alarm Digest email and the triggered Alarm. Now the datetime has the same Timezone in both cases.
2020-08-11 clustercontrol-1.7.6-7146 clustercontrol-controller-1.7.6-4077
Frontend
- Fixed an issue with retrieving roles where a non super-admin LDAP users always end up at the first cluster in the list.
- Fixed an issue editing an OpsGenie integration which prompted the user to enter information in a field, but it was not possible.
Controller:
- HAProxy: Fixed an issue using non-default ports as a user-specified value would be set to the default.
- Mariabackup: A fix to support Mariabackup 10.4.14 which has dropped support for some options.
- Deploy: Fixed a bug deploying Percona on CentOS 8.
2020-08-04 clustercontrol-1.7.6-7124 clustercontrol-notifications-1.7.6-254
Frontend
- Galera: Fixed an issue which made it impossible to activate Galera SSL Encryption when SSL Encryption was enabled
- Galera: Server Load graphs were not properly initialized when there was no data to graph (e.g, because a server was down for a period of time).
- ServiceNow integration: Fixed a layout issue, and improved the usability by adding an 'All Clusters' to simplify when having many clusters. This fix also includes two new fields: 'Service' and 'Configuration Item'
Notifications service:
- ServiceNow: Added support for 'Service' and 'Configuration Item'.
2020-08-03 clustercontrol-controller-1.7.6-4068
Controller
- Fixing a bug deploying Percona Server and XtraDb Cluster on CentOS 8.
2020-08-03 clustercontrol-controller-1.7.6-4066
Controller
- PostgreSQL: Fixed an issue with PgBackRest using user-defined stanzas to prevent default configuration options defined by the controller from being set as command-line options. Thus, only the options set in the user-defined stanza will be used and nothing else.
2020-07-27 clustercontrol-1.7.6-7082 clustercontrol-controller-1.7.6-4059
Frontend
- Cloud Deployment: Fixed an issue where the wrong disk size unit (GB) was sent in the job instead of MB.
- Backup/Restore (MySQL based): Fixed a couple of UX issues. Restoring a backup using Point in-time recovery (PITR) may only be executed on the cluster nodes where the backup was created. All other options are now disabled (Restore on standalone/create cluster from backup).
- Import MySQL Replication: The option 'Import as a standalone node' has been removed as it did not have any purpose.
Controller
- MySQL 8.0: Fixed an issue with parsing privileges in a GRANT statement (INNODB_REDO_LOG_ENABLE privilege was missing)
- Replication: Fixed an issue retrieving/creating user account information in case there was one server in the setup and it was not configured as a master. The error manifested itself as 'Server not found while trying to create an account'
- Replication: Improved the behavior by not raising an alarm and disabling auto-recovery If the setting auto_manage_readonly=false is specified and the cluster has multiple writable masters.
- Replication:Enable/Disable read-only job: Failed to run if auto_manage_readonly=false
- ProxySQL: Failed to sync instance in ProxySQL (GRANT option).
2020-07-20 clustercontrol-1.7.6-7059 clustercontrol-controller-1.7.6-4047
Frontend
- Integrations: Fixed a bug when adding cluster on integration channel if cluster name only 2 characters.
- PostgreSQL: Enable timescaledb for PostgreSQL 12.
- User mgmt: Fixed an issue preventing a SuperAdmin used logged in from LDAP to change a cluster team.
Controller
- PostgreSQL: Fixed an issue where the controller failed to parse pg_hba.conf when a line ends up with empty space before a new line.
- PostgreSQL: Ensure that directories created for PostgreSQL have the correct rights and even the newly created parent directories, such as /etc/postgres.
- General: Extended OS compatibility matrix with Ubuntu 'focal' / 20.04.
2020-07-10 clustercontrol-controller-1.7.6-4036
Controller
- A fix for a race condition when the SSH connection is lost for a moment when sampling processes. This could lead to the process (e.g HAProxy, Garbd, ProxySQL) to have the wrong state for a short period of time.
- MongoDb: Consistent backup failed because the Storage Host was not set.
2020-07-05 clustercontrol-controller-1.7.6-4026
Controller
- Galera: Improved Cluster Split detection. Now, the cluster_size is measured over a three-second period, and the cluster will enter failed state if the cluster_size is not the same on all nodes after this period of time.
- PostgreSQL: Rebuilding a PostgreSQL node as a slave could make it appear with the role set to master (but non-writable, and streaming from the writable master).
- ProxySQL: Removed unnecessary log messages when installing ProxySQL.
2020-06-28 clustercontrol-1.7.6-6996 clustercontrol-controller-1.7.6-4013
Frontend
- Query Monitor: Running Queries did only appear on the last page when filtering on hosts.
- User Management: The number of visible Teams/LDAP groups was limited and more than 33 groups could not be shown in the UI.
Controller
- Query Monitor: Purge Query Monitor for MySQL did not purge the performance_schema events_statements_summary_by_digest.
- Ping time was set incorrectly (to a big value) when blocked by firewall or ICMP disabled in conf. Now it is set to -1 if blocked by the firewall or disabled.
- HAProxy: It was possible to import an non-existing HAProxy.
- ProxySQL: Fixed a bug syncing instances error when a database name contains backslash.
- ProxySQL: Fixed an issue with MariaDB when importing users with a role in ProxySQL.
- ProxySQL: Fixed an issue Installing ProxySQL 1.x failed on CentOS7.
- ProxySQL: Could not install version 1 to two nodes in the same job.
- ProxySQL: Failed to stop the ProxySQL service while removing and uninstalling the node.
2020-06-20 clustercontrol-1.7.6-6976 clustercontrol-controller-1.7.6-3996
Frontend
- Query Monitor: Fixed a bug when purging data in the Query Monitor.
Controller
- SSL Certificates: Fixed a bug that prevented self-signed certificates to be imported. The error manifested itself as: "Error 'CA certificate: Empty PEM string'".
- MaxScale: The MaxScale nodes could in some situation appears as "not available"/"offline", but the process was actually running.
- Backups: Fixed a bug where a backup could end up in the wrong backup directory if the backup was re-executed too soon after a failed backup.
2020-06-16 clustercontrol-1.7.6-6959 clustercontrol-controller-1.7.6-3985
Frontend
- MongoDB: Dashboards metrics updated to support new mongodb_exporter. A re-install of the MongoDB Exporter is needed, which is done from the Dashboards action menu.
- Schema Analyzer: showed no data for community edition.
- Stop Node action must always be visible. Even if the node is down/unknown.
- Backup Scheduling: An issue specifying the time when using advanced settings.
- User management: A User with 'Admin' role cannot open the mail notifications page
- User management: Users are shown in the wrong group (fixed 'All users' logic).
- User management: LDAP users can't see alarms or jobs.
Controller
- Monitoring/disk: A fix was added to avoid monitoring the NFS filesystem.
- PostgreSQL: In case of an inconsistent view (master down, but LB or slave reports it is up) then double-check using SSH.
- PostgreSQL: Log the replication failure alarm reason and server disconnected reason in the alarm text.
2020-06-08 clustercontrol-controller-1.7.6-3972
Controller
- ProxySQL: Supporting MariaDb roles when importing users to ProxySql
- MongoDB: Upgraded mongodb_exporter to v0.11.0 to support newer MongoDB versions.
- HAProxy: Fixed an issue where the node appears as Online but the VM is not even running.
- Galera: Failed to create slave cluster from backup for Galera.
- PostgreSQL: Cluster-to-Cluster replication shows Cluster Failure in the slave cluster.
- PostgreSQL: Failed to Create Slave Cluster on TimescaleDB.
- Notifications: Extended the fallback email address query with, dcps.users with company_id=0, and the RPCv2 owner user of the cluster. This ensures that an admin that can see all clusters will get notifications from all clusters.
2020-05-15 clustercontrol-1.7.6-6868 clustercontrol-controller-1.7.6-3940
Frontend
- CC Teams and Users management issue (removed the strict linking on company for SuperAdmin)
Controller
- PostgreSQL: Slave rebuild doesn't work for PostgreSQL.
- PostgreSQL: Failed create PostgreSQL cluster from pg_basebackup.
- PostgreSQL: Remove slave (recovery|standby) signal files after restoring pg_basebackup.
- Galera: Automatic failover is not working on MariaDB Cluster with slave nodes.
- Galera: Create Galera Cluster From Backup Fails
- Galera: Creating a Slave Cluster using PXC 5.6 failed. See note above.
- Galera recovery fails repeatedly if automatic recovery is enabled (huge dataset) b/c of a systemd script timeout. Now CMON will patch the vendors' broken systemd script.
- Galera: PXC 5.7 failed to deploy on Centos 8.
- ProxySQL: Fix for wildcard handling in MySQL grants (fixes a ProxySQL import users issue...).
- MySQL/Galera: Added parser support for new MySQL 8.0 privileges.
- MongoDb: Deployment fails and fixed by preventing /var/run & /run from any owner/access changes, it makes the SSH connections failing.
2020-05-06 clustercontrol-1.7.6-6854 clustercontrol-controller-1.7.6-3910
Frontend
- HAProxy: Auto-filling HAProxy socket, port, and credentials fields are not working in the import section (fixed template).
Controller
- PostgreSQL: Fix a pg_hba parsing error (whitespace in empty lines).
- PostgreSQL: Bugfix for duplicated pg_hba entries.
- PostgreSQL: Bugfix for repetitive CREATE ROLE calls following a failover.
- MongoDb: Backups created by s9s CLI did not contain the node name in the backup file.
- MaxScale: Remove/Register fixes
- MySQL: A strong root password is now auto-created if not specified explicitly by the job.
- MySQL: Refresh variables after restarting a node so the node is up to date in the UI.
- Prometheus: make sure tar and gzip is installed to be able to deploy the packages.
- cmon_upgrade.log: add timestamp & filenames
2020-05-03 clustercontrol-1.7.6-6846
Frontend
- HAProxy: Import error, fixed the job spec.
- Redundant nodes when Select Stream from Master in 'Create Slave Cluster' dialog.
- Backup: Got error 'Cannot set unknown key encrypt_backup on RecordType' in the UI when configuring backup with verifying backup (added property to Verification model and fixed unit tests).
- CSS Fixes.
2020-04-27 clustercontrol-controller-1.7.6-3892
Controller
- s9s_error_reporter is not working for Cluster ID 0 (fixed error-report fallback path).
- PostgreSQL: Include the pgdg common repo (for pgbackrest on centos/rhel).
- PostgreSQL: Fixes to failover in case of deleting/erasing the master's datadir.
- PostgreSQL: Ping lets do a disconnect first, so we can detect if no new connection can be made to the PostgreSQL server.
- MySQL: Bugfix for parsing the role syntax of a MySQL Db user, which could lead to the frontend failing to handle the request to show database users in Manage->Schema and Users.
2020-04-22 clustercontrol-1.7.6-6830 clustercontrol-controller-1.7.6-3880
Frontend
- Backup Schedule: When changing a backup method (from none-PgBackRest) to PgBackRest it could cause the UI to become stuck.
- Overview graph: The Cluster Overview graph was truncated in some cases to 30 minutes instead of 1 hour.
Controller
- Verify Backup: A user will be notified by email if the verification fails.
- PostgreSQL: Backup Verification made a backup of datadir before restoring the backup, which was unnecessary.
- PostgreSQL: Fixed an issue with replication lag calculation and alarming.
- PostgreSQL: Skip nodes from failover whose lagging more than MAX_REPLICATION_LAG setting.
- MySQL Replication: A fix for rebuilding replication slave where there was a race condition checking if MySQL is down.
- Galera: Fixed an issue when manipulating my.cnf files that could manifest itself as "Got error Could not read 'wsrep_provider_options'" when enabling Galera SSL Encryption.
- Galera: Add a Replication Slave in PXC 5.7 overwrote the my.cnf if it was a symlink.
- Password Escaping: Fix a password escaping issue in cmon configuration, that could lead to e.g the Prometheus database exporters to fail to connect to the database.
- LibSSH: Fixes to prevent zombie/defunct ssh proxy commands (such as sssd_ssh_known_hosts_proxy ) processes due to a missing waitpid in libssh.
2020-04-10
clustercontrol-1.7.6-6815
clustercontrol-controller-1.7.6-3854
clustercontrol-notifications-1.7.6-251
clustercontrol-cloud-1.7.6-241
clustercontrol-ssh-1.7.6-92
Feature Details
Cloud Deployment of HAProxy
- Deploy a database stack containing your favorite SQL database and HAProxy load balancer.
MySQL Freeze Frame (BETA)
- Snapshot MySQL process list before cluster failure.
Misc
- CMON Upgrade operations are logged in a log file.
- Many improvements and fixes for PostgreSQL Backup, Restore, and Verify Backup.
- A number of legacy ExtJS pages have been migrated to AngularJS.
ClusterControl v1.7.5
2020-04-08 clustercontrol-1.7.5-6810 clustercontrol-notifications-1.7.5-249 clustercontrol-cloud-1.7.5-239
Frontend
- Opsgenie Integration: A fix to allow the user to specify region when setting up the integration.
Notifications
- Opsgenie Integration: Fixed an issue resulting in the error "Failed to parse request body: parse error: expected string offset 11 of teams".
- Fixed an issue handling region.
- Improved and fixed a bug with http_proxy handing. Now, a http_proxy/https_proxy can be specified /etc/proxy.env or /etc/environment.
Cloud
- Improved and fixed a bug with http_proxy handing. Now, a http_proxy/https_proxy can be specified /etc/proxy.env or /etc/environment.
2020-04-07 clustercontrol-controller-1.7.5-3844
Controller
- HAProxy: Using ports 5433 (read/write) and 5434 (read-only) by default for PostgreSQL
- HAProxy: PostgreSQL - Read/write splitting was not setup when installing HAProxy from the S9s CLI.
- HAProxy: Installing HAProxy attempted to use the Backup Verification Server too.
- PostgreSQL: Never stopping 'Failover to a New Master' job + cluster status bugfix (it must be in Cluster Failed state when there is no writable master)
- PostgreSQL: Dashboards: Failed to deploy agents in some cases on the Data nodes.
- PostgreSQL: Import recovery.conf/postgres.auto.conf and can now be edited in the UI.
- PostgreSQL: pg_hba.conf is now editable on UI.
- PostgreSQL: pg_basebackup restore: first undo any previous PITR related options before restoring.
- PostgreSQL: Failed to Start Node for PostgreSQL.
- PostgreSQL: Fix pg_ctl status retval and output handling.
- PostgreSQL: Rebuild replication slave did not reset restore_command.
- Percona Server 8.0: Verification of partial backup failed.
- ProxySQL: Could not edit backend server properties in ProxySQL for Galera.
2020-04-01 clustercontrol-controller-1.7.5-3828 clustercontrol-notifications-1.7.5-243
Notifications
- cmon-events do not read MySQL connection details from /etc/cmon-events.cnf
- Password handling: Using a special character was rejected by cmon-events service.
- Remember to restart the service: "service cmon-events restart" after the upgrade.
Controller
- Spelling fix for cluster action 'Schedule and Disable Maintenance Mode'.
- PostgreSQL: Verify Backup, recreate missing datadir and config file if missing on the Backup Verification Server.
- PostgreSQL: Failed to Start Node for PostgreSQL
- PostgreSQL: Failed to PITR pg_basebackup because standby_mode was ON, preventing the node from leaving recovery.
- PostgreSQL: Hide passwords from PostgreSQL logs
- Error Reporting: Fixed a number of small issues.
2020-03-31 clustercontrol-1.7.5-6794
Frontend
- Spelling fix for cluster action 'Schedule and Disable Maintenance Mode'.
2020-03-30 clustercontrol-controller-1.7.5-3819 clustercontrol-1.7.5-6791
Frontend
- PostgreSQL: Point in time recovery (PITR) - fixes when selecting stop time and timezone.
- PostgreSQL: Fixed and improved restore backup to show the correct options for pg_basebackup regarding PITR.
- Cloud Deploy: Added missing references to our online documentation on how to create/add cloud credentials.
- Sync Clusters: Sync the UI view of clusters with the controller.
Controller
- PostgreSQL: Recovery of Slaves will not commence if the master is down
- PostgreSQL: Verify Backup now works when Install Software is enabled and Terminate Server is disabled.
- PostgreSQL: Promote failed when WAL replay is paused.
- PostgreSQL: Point in time recovery (PITR) fixes for pg_basebackup.
- Notifications: Alarms raised by the controller are only sent once to each recipient.
Limitations:
- PostgreSQL PITR:
- If no writes have been made after the backup, them PITR may fail.
- Specifying time too far in the future may cause issues too
- We recommend using pg_basebackup in order to use PITR
- PostgreSQL Backups [pgbackrest & pg_basebackup]:
- pgbackrest has an archive_command that is not compatible with pg_basebackup, which means e.g that a pg_basebackup cannot be restored using PITR on a PostgreSQL server configured with an archive_command configured for pgbackrest.
2020-03-23 clustercontrol-controller-1.7.5-3797 clustercontrol-1.7.5-6757
Frontend
- Verify Backup: Specifying the temporary directory field is mandatory, but it is not used at all.
- Prometheus: Graph for disk usage is incomplete
- Prometheus: Not possible to change Prometheus deployment options when deployment failed.
- PostgreSQL: Point in time recovery (PITR) depends on PostgreSQL archive_command. An archive command suitable for PgBackRest is not working for pg_basebackup. Now, PITR options are only shown for a backup method if the underlying archive command supports it.
- PostgreSQL: PITR: Fixed timezone transformation for PITR
- Query Monitor: Fixed bug saving settings.
- Overview/Node Graphs: In some circumstances the date range could be the same for From Date and To Date, resulting in zero data points and no graph displayed.
- Audit Log: The timestamp in the auth.log file is off by 1h (default UTC)
- Error Reporting: A wrong Error Report Default Destination was shown.
Controller
Bugs Fixed:
- ProxySQL: Version is not updated in Topology view
- PostgreSQL: PG Master node fails if you Enable WAL archiving after promoting it
- PostgreSQL: Verify pg_basebackup (potentially other pg backup methods too) fails.
- PostgreSQL: Promoting a slave where a master cannot be determined or reached.
- PostgreSQL: Fixed an issue with pg_basebackup and multiple tablespaces (NOTE: encryption isn't supported for multiple tablespaces).
- PostgreSQL: PgBackRest with Auto Select backup host fails.
- PostgreSQL: Restoring PgBackRest backup on PostgreSQL12 failed.
- PostgreSQL : Make sure the recovery signal file is not present when enabling WAL log archiving.
- PostgreSQL: Fallback to server version from configuration when the information is not available in the host instance.
- PostgreSQL: Verify WAL archive directory for log files before performing PITR.
- Query Monitor: Disable Query Monitor is not working by setting enable_query_monitor=-1 in /etc/cmon.d/cmon_X.cnf
- Galera: Force stop on the node does not prevent further auto-recovery jobs.
- Galera: Node recover job fails but is shown in green.
- Galera: Backup is not working for non-synced nodes in Galera Cluster. This allows mysqldumps to be taken on non-synced nodes as xtrbackup/mariabackup tools prevent this.
- MariaDB: MariaDB 10.3/10.4 promote slave action fails.
- Repository Manager: Updated and added missing versions and removed some deprecated versions.
Behavior change: - Backup Verification Server: Applies to MySQL based systems only (PostgreSQL coming soon). It is now possible to reuse an up and running Backup Verification Server (BVS). Thus, a BVS does not need to be shutdown before Verifying the backup.
- Host Discovery: A new way to execute host discovery and logging to /var/log/cmon_discovery*.log
2020-03-04 clustercontrol-1.7.5-6697
Frontend
- Auth logging. Added TZ support. Server TZ is by default, but another TZ can be set in/var/www/html/clustercontrol/boostrap.php.
2020-03-03 clustercontrol-controller-1.7.5-3735 clustercontrol-1.7.5-6695
Frontend
- Auth logging. Login/logouts and failed login attempts are stored in /var/www/html/clustercontrol/app/tmp/logs/auth.log
Controller
- PostgreSQL: Fixed a bug in Database Growth.
2020-03-01 clustercontrol-controller-1.7.5-3730 clustercontrol-1.7.5-6685
Frontend
- Cloud Deployment Wizard: Updated to latest supported vendors versions.
- PostgreSQL: Fixed an issue showing replay_location in e.g Topology View.
Controller
- MongoDb: wrong template used for MongoDb and Percona MongoDb 4.2.
- Query Monitor (mysql): datadir and slow_query_log_file variables read too often.
- TimeScaleDb. Rebuild slave fails on installed but not registered TimeScaleDb.
- MySQL/Galera: Upgrade MySQL/Galera packages in one batch instead of installing/upgrading them one-by-one.
- Include latest haproxy sample in the error-report.
- General: staging_dir from cmon.cnf is not respected.
- Percona 8.0: Can't deploy ProxySQL on a separate non-db node in Percona 8.0.
2020-02-09 clustercontrol-controller-1.7.5-3679 clustercontrol-1.7.5-6646
Frontend
- Create Slave Cluster action not working immediately after deploying a cluster.
- MaxScale: Make MaxScale available for Keepalived.
- Load balancers: Added options to avoid disabling SELinux and firewall.
- Cluster List: Sorting Clusters.
Controller
- ProxySQL: Fixed a bug deploying ProxySQL on a separate node in a Percona Server 8.0 Cluster.
- Prometheus/Dashboards: Fixed an issue DNS resolve so that the mysqld_exporter with the property db_exporter_use_nonlocal_address, properly handles the skip name resolve flag.
- PostgreSQL: Fixed an issue when the controller always tried to connect to a 'postgres' DB even if no database was specified.
2020-01-20 clustercontrol-controller-1.7.5-3666 clustercontrol-1.7.5-6627
Frontend
- Nodes Page: Fixed the time range on the Db Performance Graph.
- Nodes Page: Fixed the 'Swap Space' graph.
- Cluster List: Fixed a sorting order issue.
Controller
- ProxySQL: Fixed a bug where backup failed.
- Replication/MySQL 8.0: Fixed a bug deploying MySQL 8.0 (Oracle) on Centos8/RHEL8 and also fixing adding replication slave
- Prometheus/Dashboards: make sure dnsLookup is called for 'useNonLocalAddress' option, so IP gets granted too.
- MaxScale: Enabled installation on Debian10/Buster.
2020-01-20 clustercontrol-controller-1.7.5-3638 clustercontrol-1.7.5-6619
Frontend
- MongoDB: Add 4.0 and 4.2 versions for both mongodb.org and percona vendor in the UI
- MySQL/Backup: Added 'qpress' compression option.
- Backups: Netcat/socat port is now specified in 'Global Settings'.
- Backups: Added check on Failover host so it cannot be set to the same value as the primary backup host.
- Cluster List: Fixed a sorting order issue.
Controller
- MySQL/Backup: Auto-install 'qpress' during restore/verify when required.
- MySQL/Replication A segfault when failover master could happen in MySQL 8.0.
- MySQL: Disable unsupported variables for 5.5.
- ProxySQL: Avoid executing SQL init commands on the connection (crashing bug in ProxySQL 1.4.10, fixed in ProxySQL 1.4.13).
- MongoDB 4.2: Fixed an issue Importing a Cluster due to new lines in the keyfile.
- MongoDB: Fixed a missing cloud badge on mongo clusters created in the cloud
- PostgreSQL: Improve the free disk space detection before rebuild slave.
- PostgreSQL: Create cluster in the cloud failed because no postgresql version was specified.
- PostgreSQL: Auto-rebuilding failed replication slaves now resorts to use the full node rebuild strategy instead of pg_rewind as it knows to fail in a number of scenarios.
- Dashboards/prometheus exporters: New configuration option: db_exporter_use_nonlocal_address
2020-01-07 clustercontrol-controller-1.7.5-3616 clustercontrol-1.7.5-6604
Frontend
- Cluster Overview (MySQL based clusters): Fixed an issue with the Query Outliers which relied on deprecated code.
- Node Actions: The Stop Node action is always visible so it is always possible to stop a node.
Controller
- Notifications: 550 5.6.11 SMTPSEND.BareLinefeedsAreIllegal : fixing an error with certain SMTP servers.
- PostgreSQL 9.7 with TimeScaleDB: Add node fails on CentOS7 & CentOS8
2019-12-18
clustercontrol-1.7.5-6599
clustercontrol-controller-1.7.5-3601
clustercontrol-notifications-1.7.5-201
clustercontrol-ssh-1.7.5-88
clustercontrol-cloud-1.7.5-225
In this release we are introducing cluster-wide maintenance mode, taking snapshots of the MySQL database status and processlist before a cluster failure, and support for new versions of PostgreSQL, MongoDB, Centos and Debian.
We have previously supported maintenance mode for one node at a time, however more often than not you want to put all cluster nodes into maintenance.
Cluster-wide maintenance mode enables you to set a maintenance period for all the database nodes / cluster at once.
To assist in finding the root cause of failed database nodes we are now taking snapshots of the MySQL status and processlist which will show you the state of the database node around the time where it failed. Cluster incidents can then be inspected in an operational report or from the s9s command line tool.
Finally we have worked on adding support for Centos/RedHat 8, Debian 10, and deploying/importing MongoDB v4.2 and Percona MongoDB v4.0.
Feature Details
Cluster Wide Maintenance
- Enable/disable cluster-wide maintenace mode with cron based schedule.
- Enable/disable recurring jobs such as cluster or node recovery with automatic maintenance mode.
MySQL Freeze Frame (BETA)
- Snapshot MySQL status before cluster failure.
- Snapshot MySQL process list before cluster failure (coming soon).
- Inspect cluster incidents in operational reports or from the s9s command line tool.
Updated Version Support
- Centos 8 and Debian 10 support.
- PostgreSQL 12 support.
- MongoDB 4.2 and Percona MongoDB v4.0 support.
Misc
- Synchronize time range selection between the Overview and Node pages.
- Improvements to the nodes status updates to be more accurate and with less delay.
- Enable/disable Cluster and Node recovery are now regular CMON jobs.
- Topology view with cluster to cluster replication.
ClusterControl v1.7.4
2019-12-16 clustercontrol-1.7.4-6594 clustercontrol-controller-1.7.4-3596
Frontend
- AWS: Updated region dropdown list.
Controller
- PostgreSQL: Failed to start PostgreSQL after VM halt&reboot xt(because of a missing socket directory).
- HAProxy: Fixed a parser issue and add '^' also to supported string/regexp characters list.
2019-12-01 clustercontrol-controller-1.7.4-3565
Controller
- Replication: Removing BVS server failed.
- Deploy: Dropped ntp package dependency during deployment.
2019-11-23 clustercontrol-1.7.4-6537 clustercontrol-controller-1.7.4-3556
Frontend
- Topology View: Show link to remote cluster.
- Rebuild Replication Slave: Wrong cluster id was sent in the job.
Controller
- ProxySQL 2.x: Setting writer_is_also_reader=2 in mysql_galera_hostgroups.
- ProxySQL 1.x: "Sync Instances" fails with no such table: mysql_galera_hostgroups.
- HAProxy: Fixing haproxy parser (extended string with the following chars: |[]).
- MySQL: Backups can't be taken with xtrabackup 2.4.12.
2019-11-18 clustercontrol-controller-1.7.4-3543
Controller
- Crashing bug.
2019-11-17 clustercontrol-1.7.4-6513 clustercontrol-controller-1.7.4-3541
Frontend
- Rebuild Replication Slave: Wrong cluster id was sent in the job.
Controller
- Email/digest: Fixed an issue sending too many digest messages sent in certain cases.
- Email/digest: Fixed and issue sending blank digest emails.
- Host Discovery: Fixed a deadlock issue.
- PostgreSQL: Rebuilding a slave failed as the master could not be found.
2019-11-09 clustercontrol-controller-1.7.4-3526 clustercontrol-1.7.4-6502
Frontend
- Query Monitor -> Running Queries: Refresh button and fixed an issue limiting the result set to 200 records.
- Alarms: Fixed a bug with Ignore alarms.
Controller
- ProxySQL: Failed deploy with import configuration option.
- Cluster to cluster replication: Failed to locate master when creating slave cluster from backup.
- Replication: Percona Server 8.0 replication cluster creation failed during repl_user user creation.
2019-11-06 clustercontrol-controller-1.7.4-3519
Controller
- Cluster to cluster replication: Check the master exists in the parent cluster before attempting to stage the cluster.
2019-11-01 clustercontrol-controller-1.7.4-3512 clustercontrol-1.7.4-6483
Frontend
- MySQL: Added an option to RESET SLAVE / RESET SLAVE ALL.
- MongoDb: Removed MongoDb 3.2 as an option on Ubuntu 18.04.
- Dashboard: Added Dashboards to the ACL list.
- Query Monitor -> Running Queries: Refresh button and fixed an issue limiting the result set to 200 records. However, automatic reloading affects the pagination and will be fixed in the next patch release.
Controller
- ProxySQL 2.0: The proxysql_galera_checker script is not needed any longer and instead ClusterControl uses the mysql_galera_hostgroups table.
- PostgreSQL: copy some mandatory values from master's config into slave's config when configuring replication (as per https://www.postgresql.org/docs/9.6/hot-standby.html#HOT-STANDBY-ADMIN ).
- PostgreSQL: Database growth had an issue when detecting disk space.
2019-10-28
clustercontrol-1.7.4-6459
2019-10-25
clustercontrol-1.7.4-6451
2019-10-24
clustercontrol-1.7.4-6442
clustercontrol-controller-1.7.4-3503
clustercontrol-cloud-1.7.4-220
clustercontrol-ssh-1.7.4-84
clustercontrol-notifications-1.7.4-190
In this release we now support cluster to cluster replication for MySQL Galera and PostgreSQL clusters.
One primary use case is for disaster recovery by having a hot standby site/cluster which can take over when the main site/cluster has failed.
We also added support for MariaDB 10.4/Galera 4.x, ProxySQL 2.0 and managing database users for PostgreSQL clusters.
Feature Details
Cluster to Cluster Replication
- Asynchronous MySQL replication between MySQL Galera clusters.
- Streaming replication between PostgreSQL clusters.
- Clusters can be rebuilt with a backup or by streaming from a master cluster.
Misc
- MariaDB 10.4/Galera 4.x support.
- ProxySQL 2.0 support.
- Database User Management for PostgreSQL clusters.
=========================================================================
2019-10-21 clustercontrol-controller-1.7.3-3496
Controller
- HAProxy: Added 'tcp-check connect' to configuration templates.
2019-10-20 clustercontrol-controller-1.7.3-3494 clustercontrol-1.7.3-6429
Frontend
- PostgreSQL: Fixed an issue with the charts on the Cluster Overview page
Controller
- PostgreSQL: Query Monitor -> Query Statistics, Exclusive Lock Waits was not working correctly and did not display all data.
- Dashboard/SCUMM: Fixed an issue recoverying Prometheus exporters in case of co-located cluster nodes by multiple-clusters.
- MongoDb: Importing a single node will now fail if the node is not set up as a replica set member. Thus, it is the user's responsibility to convert the node to a member before importing it.
2019-10-13 clustercontrol-controller-1.7.3-3482 clustercontrol-1.7.3-6403
Frontend
- Dashboards/PostgreSQL: Fixed an issue with Idle and Active Connections
- Backup: Can't use backup verification server due to a bug in Host discovery.
- Email Notifications: Improvements to email validation of 'External' users and Adding/Removing of these 'External' users.
Controller
- Dashboards/PostgreSQL:
- Active and Idle connection dashboards aren't working for PostgreSQL.
- A redeploy of the postgres_exportes is needed.
- Reverted back to postgres_exporter 0.4 as 0.5 was very bugg.
- Active and Idle connection dashboards aren't working for PostgreSQL.
- Node Charts: Node CPU chart was incorrect on Centos6/RHEL6 due to it had one less column (no guest-low counter value).
- Notification: Fix daily limit handling of e-mail message recipients where -1 was not handled correctly.
- Error-reporting: There was a problem with file listing when multiple files was specified since we bash-escape the paths for safety, not it works fine.
- HAProxy: Fixed an issue parsing the HAProxy config file.
- HAProxy: While setting up haproxy for PostgreSQL reading old password from checker script fails.
- PostgreSQL: Importing a node/cluster: If logging_collector=OFF and user has not specified a custom log file then the job will be aborted and the user must specify it.
2019-09-29 clustercontrol-controller-1.7.3-3450 clustercontrol-1.7.3-6368
Frontend
- MySQL: Performance -> Transaction Log uses timestamp and not epoch.
- Fixes usability issues with Runtime Configuration making it easier to read
- PostgreSQL: Fixes in Import / Add Replication Slave dialogs with respect to Port and Logfile fields.
Controller
- MySQL: Performance -> Transaction Log uses timestamp and not epoch.
- MySQL: Fixed an issue with excessive logging of long running queries.
- HAProxy: Fix of parsing errors during collect_configs cronjob (in case of HAProxy and ProxySQL nodes).
- error-reporter: Include complete cmon log files and not only the last rows.
2019-09-24 clustercontrol-controller-1.7.3-3440
Controller
- MySQL based systems: Fixed and issue with excessive logging of long running queries.
- SSH Communication: A number of improvements which fixes intermittent errors like 'test sudo failed' and 'SUDO failed'.
2019-09-17 clustercontrol-controller-1.7.3-3428
Controller
- MySQL Replication Clusters: A fix to update the status of the failed server in ProxySQL. The old master will now be marked as OFFLINE_SOFT. Any node that is not part of the replication topology is marked as OFFLINE_SOFT.
- Added a fix that could cause a crash if a database connection could not be established.
2019-09-10 clustercontrol-controller-1.7.3-3413
Controller
- MariaDb: Setting innodb_thread_concurrency=0 due to https://jira.mariadb.org/browse/MDEV-20247
2019-09-08 clustercontrol-1.7.3-6340, clustercontrol-controller-1.7.3-3407
Frontend
- Backup: Fixed an issue with scheduling a backup. If using cron settings, then due to TZs and conversions to UTC then a specified hour could be converted to an hour belonging to another day.
- LDAP: Wrong LDAP status was shown in the UI
- Email Notifications: Adding a recipient without having any clusters installed failed
Controller
- ProxySQL: Inserting a query rule with a duplicate query rule id caused the query rule ids smaller than the duplicate to become negative.
- Prometheus version bump to v2.12
- PostgreSQL: On RedHat systems the default datadir was set to 'main' instead of 'data'.
- MongoDb: Retention fails because all mongo backups were recognised as partial, and partial can only be removed if there are more than one "full" backups.
- A fix for an infinite amount of 'Job query is working again.' log messages in the cmon log.
- Removing storage of log messages in a deprecated table called 'collected_logs'.
2019-08-24 clustercontrol-1.7.3-6322, clustercontrol-controller-1.7.3-3388
Frontend
- PostgreSQL: Add Slave: help text next to "logfile" text box.
Controller
- Import/Add Cluster: Specified sudo password was not respected.
- MongoDb: Importing a cluster failed even if the CAFile is specified following an error where it was not specified, because existing cert data was not updated in cmon's certificate storage.
- Controller: Must keep trying to connect to the MySQL server even if the MySQL server is not started, instead giving up and exit.
- PostgreSQL: Whitelist is not working as documented.
- SCUMM/Prometheus: General small improvements with disk device detection and mapping.
2019-08-17 clustercontrol-controller-1.7.3-3374
Controller
- PostgreSQL: a crashing bug was fixed that was caused by assuming that 'cluster_name' always have a value.
- PostgreSQL/pgbackrest: Fixed an issue when the backup.manifest is encrypted the backup appeared as failed. Please note that the backup.manifest record is not decrypted so some meta data information may not be updated (pending feature request).
- Controller backup/save controller: Fixed an issue saving the controller with a non-quoted password causing mysqldump to fail.
- ProxySQL: Fixed an issue where an error message was repeated due to trying to connect from a remote node using the 'admin' user, which is forbidden in ProxySQL.
- Error Reporting: Fixed a user handling issue, causing the error report to fail.
- MySQL: Database Growth, adding more verbose logging in case of issue.
2019-08-15 clustercontrol-1.7.3-6298, clustercontrol-controller-1.7.3-3370
Controller
- Performance -> Transaction Log: Fixed an issue with pagination.
Frontend
- Performance -> Transaction Log: Fixed an issue with pagination.
- Fixed an issue with JS code generation for older browsers by upgrading corejs.
2019-07-29 clustercontrol-1.7.3-6279, clustercontrol-controller-1.7.3-3336
Controller
- Added support for openntpd as an alternative to the ntp dependency.
- MySQL 8.0: Fixed an issue where the keyword 'groups' was used in a query.
- Improved error reporting in case of SSH errors when trying to determine the MySQL connect string.
- PostgreSQL: Create a symlink to custom log file during add existing cluster as well, not only during add exisitng node.
PostgreSQL: When adding an existing cluster, a custom specified log file will be be used if logging_collector is off. - PostgreSQL: Fixed an issue detecting log files.
- MySQL: A password could be visible in the 'ps' output of a node when the cmon database was updated at controller startup.
- Create/register cluster: Handle 'company_id' if provided, otherwise we try to query it up by user_id as a fallback.
Frontend
- Fixed an issue where a cluster could not be registered due to a missing company id / team id.
2019-07-24 clustercontrol-1.7.3-6270
Frontend
- Fix an issue saving and pushing out edited configuration files (Configuration Management).
- Fix an issue with the Overview page not being properly shown after switching between tabs (PostgreSQL).
2019-07-18 clustercontrol-1.7.3-6255, clustercontrol-controller-1.7.3-3319
Controller
- Postgres: Fixes in log file handling to check if the log collector is enabled already. This could result in e.g the wrong log file was used.
- Postgres: A fix in multi-node support when adding nodes that could lead to nodes not being part of the replication topology.
- Postgres: Fixed an issue when the logfile was not owned by the postgres user.
- Postgres: Updated the repository signature.
- TimescaleDb: Fixed an issue adding a replication slave due to a version mismatch.
- TimescaleDb: Fixed an issue when rebooting TimeScale (and PostgreSQL) master results in two master nodes.
- MariaDb/Replication: Fixed an issue with Promote Slave ( Switch over ).
- MariaDb/Galera: Fixed a check for the wsrep_sst_method to check whether xtrabackup vs. mariabackup is used.
- MySQL/MariaDb: Importing a cluster could fail as it assumed bind_address existed as a server system variable.
Frontend
- Add a workaround to sort the cluster list by name, status, type with a new bootstrap.php variable (instead of using cluster_id by the default)
- define('CLUSTER_LIST_SORT_BY', 'name'); # sort by cluster name
- Add additional information on how to use the 'Stanza Name' with PgBackRest backups
- Add missing confirmation dialog for MongDB restore backup
2019-07-16 clustercontrol-1.7.3-6242
Frontend
- Fix a HTML formatting issue when trying to change non-dynamic parameters in Configuration Management (MySQL).
- Fix an issue with the Nodes->DB Performance chart which requested unfiltered datasets.
2019-07-12 clustercontrol-1.7.3-6226
Frontend
- Fix missing mysqldump backups (PITR) for 'Add Replication Slave' when rebuilding with a backup.
- Fix incompatible array notation with PHP v5.3.
ClusterControl v1.7.3
2019-07-02
clustercontrol-1.7.3-6209
clustercontrol-controller-1.7.3-3293
clustercontrol-cloud-1.7.3-217
clustercontrol-ssh-1.7.3-79
clustercontrol-notifications-1.7.3-182
In this release we have added support for running multiple PostgreSQL instances on the same server with improvements to PgBackRest to support those environments.
We have also added additional cluster types to our cloud deployment and support for scaling out cloud deployed clusters with automated instance creation. Deploy MySQL Replication, PostgreSQL, and TimeScaleDB clusters on AWS, GCE, and Azure.
Feature Details
PostgreSQL
- Manage multiple PostgreSQL instances on the same host.
- Improvements to pgBackRest with non-standard instance ports and custom stanzas.
- New Configuration Management page to manage your database configuration files.
- Added metrics to monitor Logical Replication clusters.
Cloud Integration
- Automatically launch a cloud instance and scale out your database cluster by adding a new DB node (Galera) or replication slave (Replication).
- Deploy following new replication database clusters:
- Oracle MySQL Server 8.0
- Percona Server 8.0
- MariaDB Server 10.3
- PostgreSQL 11.0 (Streaming Replication).
- TimescaleDB 11.0 (Streaming Replication).
Misc
- Backup verification jobs with xtrabackup can use the --use-memory parameter to limit the memory usage.
- A running backup verification server will show up in the Topology view as well.
- MongoDB sharded clusters can add/register an existing MongoDB configuration node.
- The clustercontrol-cmonapi (CMON API) package is deprecated from now on and no longer required.
- A few more legacy ExtJS pages have been migrated to AngularJS:
- Configuration Management for MySQL, MongoDB, and MySQL NDB Cluster.
- Email Notifications Settings.
- Performance->Transaction Logs.
ClusterControl v1.7.2
2019-06-12 clustercontrol-controller-1.7.2-3142
Controller
- Fixed a CmonDb schema issue on older MySQL server versions manifesting itself as ' Specified key was too long; max key length is 767 bytes'.
- MaxScale: A fix for imported MaxScale. When importing MaxScale, the utility maxctrl is used and works currently only with socket communication on the MaxScale host itself.
- Jobs: Log files contain job spec with sensitive data.
- MariaDb: Fixed and issue with deployment of MariaDB 10.0 on Centos 6 failed.
- Postgres: Fixed a bug that could crash cmon in case wal log retention was disabled and fixed a printout in PITR job output.
2019-06-11 clustercontrol-1.7.2-6137
Frontend
- Memory leak fixes when leaving the web application open for extended periods of time (days).
- Fixes to the database software upgrades form to show correct versions supported.
Note: Only upgrades within minor versions are supported.
2019-05-24 clustercontrol-1.7.2-6069 clustercontrol-controller-1.7.2-3199
Frontend
- Deployments: Custom configuration templates can now be selected at deployment.
- Cluster Overview:
- 'Server Load' graphs were not properly displayed (PostgreSQL).
- Changing the 'Server Load' graph would not accurately show only one metric (PostgreSQL).
- Disk Reads/Writes and Uptime were set to 0 (PostgreSQL).
- Disk bytes read/written were not calculated with correct sector value of 512 bytes.
- Switching between dashboards with a specific set of steps could cause the overview page to render an empty page.
Controller
- Deadlock detection temporarily disabled for MySQL/Percona 8.0. It will be supported in the next major release.
- mysqldump failed with MySQL/Percona 8.0 because of missing show_compatibility_56=ON setting. It is now on for versions >= 5.7.6.
- Agent Based Monitoring (Prometheus):
- Uptime were set to 0.
- Disk stats for the controller is now also available.
- node_disk_written_bytes_total|node_disk_read_bytes_total are now also collected.
- Reverting to nc instead of socat on Ubuntu 16.04 due to a bug with socat's server name resolve when it starts with a number.
- Manual failover with MariaDB 10.1 for MySQL Replication cluster is now correctly flushing logs before switchover.
- Restore backup on Mongos (routers) failed to copy the data dir.
2019-05-16 clustercontrol-controller-1.7.2-3185 clustercontrol-1.7.2-6032
Frontend
- Nodes Page: Fixed an issue with y-axis scaling on the Disk Utilization chart.
- Nodes Page: Selecting the menu 'Add Replication Slave' and start adding slave was impossible when a Node recovery job was running
- MongoDB: Fixed an issue where the Restore backup dialog would not close after pressing "Finish".
Controller
- Monitoring/SCUMM: postgres_exporter and mysql exporter too URL password encoding fix which could cause a "No data points" in Dashboards -> Postgres Overview.
- Monitoring/SCUMM: A fix for disk stats to be properly shown when using LVM volumes in the Nodes -> Disk charts.
2019-05-07 clustercontrol-controller-1.7.2-3167
Controller
- MySQL 8.0: Updated imperative language files to support the previous release build issue: "Fixed an issue preventing db users from being created on MySQL 8.0".
2019-05-06 clustercontrol-1.7.2-5997 clustercontrol-controller-1.7.2-3163
Frontend
- Filtering out incomplete/failed backups from restore backup dialogs.
- MySQL Single (standalone servers): Fixed filtration logic to show the Master Nodes for MySQL Single clusters.
Controller
- MySQL 8.0: Fixed an issue preventing db users from being created on MySQL 8.0.
- Config file handling fix for docker (we mount /etc/cmon.d there and /etc/cmon.d/cmon.cnf is the main config)
2019-04-30
clustercontrol-1.7.2-5989
clustercontrol-controller-1.7.2-3155
Frontend
- Query Monitor - Query Outliers
- Fixed an issue related to date range.
- Performance > Innodb Status
- Fixed an issue when the InnoDb Status was not always shown.
Controller
- ProxySQL: Fixed an issue with importing users on MariaDb 10.2 and later.
- Galera: Fixed an issue when the recovery job was closed prematurely. This had the effect that Create Cluster could fail.
- SCUMM: Preserve the exporters of other clusters in Prometheus configuration during (re)deployment. (NOTE: users with multiple clusters and wrong Prometheus configuration may need to re-deploy the promethus on the affected [No data point] clusters).
- Query Monitor: Fixed an issue where queries were dropped following a schema update when upgrading clustercontrol-controller.
2019-04-19
clustercontrol-1.7.2-5959
clustercontrol-controller-1.7.2-3141
Frontend
- Query Monitor
- Selecting/clicking on a query didn't show the query details.
- Top queries page were empty for a single node galera cluster.
- MongoDB
- Restore backup menu item was missing.
- Restore backup dialog form was empty for single node replica sets.
- Spotlight: Performance improvements when you have several clusters / nodes.
- Cloud deployments now use the same package versions as the on-premise deployments.
Controller
- MySQL Replication: Fixed an issue with slave promotion causing an errant transaction to appear.
- Security: Fixed permissions on all cmon generated config files to be 0600.
- Galera (MariaDb): Increased start timeout for a longer SST in the mariadb.service override systemd file.
2019-04-04
clustercontrol-1.7.2-5926
clustercontrol-controller-1.7.2-3117
clustercontrol-cmonapi-1.7.2-342
clustercontrol-notifications-1.7.2-176
clustercontrol-ssh-1.7.2-73
clustercontrol-cloud-1.7.2-196
We are proud to announce an expansion of the databases we support to include TimescaleDB, a revolutionary new time-series that leverages the stability, maturity and power of PostgreSQL. TimescaleDB can ingest large amounts of data and then measure how it changes over time. This ability is crucial to analyzing any data-intensive, time-series data.
For ClusterControl, this marks the first time for supporting time-series data; strengthening our mission to provide complete life cycle support for the best open source databases and expanding our ability to support applications like IoT, Fintech and smart technology.
In this release you can now deploy a TimescaleDB and also turn an existing PostgreSQL server to a TimescaleDB server. PostgreSQL clusters also support a new backup method pgBackRest, database growth charts and improvements to manage your configuration files.
MySQL users can start to deploy and import MySQL 8.0 servers with Percona and Oracle MySQL and our new Spotlight search helps you navigate through pages, find nodes and perform actions faster.
Finally, we are also providing a beta version to setup CMON / Controller High Availability using several ClusterControl instances wired with a consensus protocol (raft) between them.
Feature Details
TimescaleDB - optimized for time-series data using SQL
- Deploy a TimescaleDB server with PostgreSQL (v9.6, v10.x and v11.x).
- Turn an existing PostgresQL server (v9.6, v10.x and v11.x) into a TimescaleDB server.
PostgreSQL
- Database growth graphs. Track the dataset growth on your databases.
- Support for pgBackRest as a backup tool:
- Create full, differential and incremental backups.
- Restore full, differential, incremental backups.
- PITR - Point In Time Recovery is supported.
- Enable compression and specify compression level.
MySQL 8.0 Support
- Cluster deployment and import of 'replication' type clusters available with:
- Percona Server for MySQL 8.0
- Oracle MySQL 8.0 Server
- Support for 'caching_sha2_password'.
CC Spotlight
- Use our new spotlight search to quickly open pages, find nodes/hosts and perform cluster and node actions.
- Click on the search icon or use the keyboard shortcut CTRL+SPACE to bring up the spotlight.
CMON / Controller High Availability (BETA)
- CMON HA is using a consensus protocol (raft) to provide a high availability setup with more than one cmon process.
- Setup a 'leader' CMON process and a set of 'followers' which share storage and state using a MySQL Galera cluster.
Misc
- Support the use of private IPs when you deploy a cluster to AWS.
- MaxScale - improved support for v 2.2 and later using maxctrl.
- Automatic vendor/version detection for importing MariaDb/MySQL based clusters.
============================================================
2019-03-25 clustercontrol-controller-1.7.1-3085
Controller
- Resolve hostnames (to IPv4) when checking a host if it exists already in other clusters.
- MongoDb: adding missing sharding:clusterRole:shardsrv value in mongod.conf when add node job is used.
- MaxScale: connection not authorized after the deploy with CC. More fixes to improve 2.3 and later support.
- Backup: Do not fail backup if wsrep desync can't be turned off, and we must set the retention on backup report even if it was marked as failed.
- Monitoring/SCUMM: haproxy_exporter: Don't append --haproxy.scrape-uri if it is already set.
- Replication: Can't add replication slave to an existing slave. Let's be stricter and do not tolerate >1 writable when setting up.
- s9s_error_reporter: make sure cmon is started, also print out the service status.
- PostgreSQL: Fixing an issue when a system file protection method denied the proxy-disable file removal
- Package handling/ YUM: Fix for a situation when package update gets stuck on user input (to accept some GPG signature).
- SSH: A fix/workaround to handle the 'forced user password change' situation if user password expires (passwd --expire USERNAME) and is prompted to change upon a successful authentication.
- SSH: limit the number of sent newline chars.
- Updated Oracle repository key due to expiration.
2019-03-18 clustercontrol-1.7.1-5812
Frontend
- Allow empty SMTP username and SMTP password for the SMTP configuration.
- Fix an issue for failing to stop MySQL slave threads (IO and SQL).
2019-03-05 clustercontrol-controller-1.7.1-3056
Controller
- Advisors: Fixed an issue with the wsrep_cluster_address.js where an "internalHostName" method was missing.
- MongoDb: Use the mongodb OS user depending on the OS and package when setting up ssl.
- PostgreSQL: Fixed a PostgreSQL grant failure because of client locale setting.
- PostgreSQL: Workaround a PostgreSQL service initdb bug. Now we call directly the 'initdb' binary. The relevant original bug report: https://www.postgresql.org/message-id/20171208104120.21687.74167@wrigleys.postgresql.org
2019-02-27 clustercontrol-notifications-1.7.1-173
Frontend
- Fix for cmon-events to prevent Avast to report it as a malware (Telegram API).
- Fix for cmon-events to start even if the MySQL server has not started first.
2019-02-20 clustercontrol-1.7.1-5720
Frontend
- Keepalived: Fixed an issue importing Keepalived.
- HAProxy: Dashboard fixes (SCUMM).
- Nodes Page: Removed the tab 'Logs' as it is deprecated and found in 'Logs->System Logs' instead.
2019-02-18 clustercontrol-controller-1.7.1-3032
Controller
- Maria Backup: Fixed an issue parsing LSN in mariabackup >= 10.2.22.
- Prometheus: Fixed an issue when restarting a failed exporter.
2019-02-13 clustercontrol-controller-1.7.1-3027
Controller
- Galera: A fix to the wsrep_cluster_address.js advisor to also check the internal/private hostname/IP-addresses.
- MySQL: skip missing grant alarms on backup-verification nodes.
2019-02-13 clustercontrol-controller-1.7.1-3026 clustercontrol-1.7.1-5700
Frontend
- ProxySQL: Fixed an issue in the pagination structure in ProxySQL sync making it impossible to Import/Export/Sync ProxySQL Configurations
- Fixed an issue regarding REPLICATION LAG where the lag was presented as a derived value instead of an absolute when viewing the individual servers.
- Fixed an issue with rebuild replication slave from incremental backup dialog.
Controller
- Fixed an issue regarding stats aggregation. This could manifests itself as spikes in particularly the REPLICATION_LAG.
- Keepalived: Small update for registering keepalived; the service port must be corrected to 112.
- Process Management: A fix for a file descriptor leak when an internal object was reused.
-
MongoDb 4.0: A fix for creating mongodb replica sets by checking executed mongodb commands for more error messages.
2019-02-06 clustercontrol-controller-1.7.1-3016 clustercontrol-1.7.1-5673
Frontend
- Deploy HAProxy on PostgreSQL: Fixed an issue where the dialog was stripped and did not load completely.
- Performance -> Db Variables: Variables with different values are not marked in red
- Dashboards: System Overview, improved the readability of the CPU Usage chart.
- PostgreSQL Query Monitor: Removed tuning advise and the option to purge queries as it is not possible at all.
Controller
- Configuration Changes: Fixed an issue where the owner and privileges of a config file was not preserved.
- Deploy/Create Cluster From Backup: A fix to prevent the restore backup from running in another job.
- ProxySQL: Replaced old galera_checker script for proxysql to a new 2.0 version one
- ProxySQL: Improved s9s CLI and cmon such that making a proxysql configuration backup can be performed using the s9s CLI.
- Advisors: A new script to check prepared statement exec limits. The advisor script must be manually scheduled by the administrator.
- Alarm Notifications: The Memory Utilisation alarm was not showing all processes in the included 'top' view.
2019-01-22 clustercontrol-controller-1.7.1-2994 clustercontrol-notifications-1.7.1-168
Controller
- MySQL/Galera: Fixed a bug in related to the loading of Disk/PU/Net stats on the Cluster Overview page.
- HAProxy/ProxySql/Garbd: disable firewall/selinux (if requested by the job, default is true for both values).
- Replication: Added a small hint about --report-host argument being required for add existing slaves.
- MongoDb: Fixed an issue when an rolling restart was attempted, but a stop/start of the cluster is required when setting up SSL.
- MongoDb: Added a 'server_selection_try_once', 'server_selection_timeout_ms' to allow the user to fine tune connection settings when e.g the network is slow. Run cmon --help-config to see the complete description.
Cmon-events/notifications
- Fixes to logging
- The License check failed due to the wrong field name, preventing e.g notification plugins from receiving alarm events.
2019-01-13 clustercontrol-controller-1.7.1-2985
Controller
- Bugfix for SSH connection negotiation failure on compression methods.
- HAProxy: A configuration error could occur when adding a new node, a 'none' word was wrongly added to the HAProxy configuration.
- HAProxy: Deploying HaProxy fails when it builds from source. Missing zlib1g-dev / zlib dependency.
- HAProxy: xinetd port was missing a default value. It now defaults to port 9200.
- Point in-time Recovery (MySQL): Binary logs could be applied in the wrong order.
- MySQL Replication: Switchover hooks do not work (replication_pre_switchover_script and replication_post_switchover_script are now executed upon Promote Slave).
- ProxySQL: Importing a user from MySQL fails to duplicate the grants.
- Prometheus: A fix to collect the log file from the Prometheus host, instead of the exporter host.
- Create cluster job fails on permissions of ssh user when the username contained \.
- NDB Cluster: Updated to use MySQL Cluster 7.5.12 binaries.
- Operational Reports: A fix to avoid repetition of node information in the 'System Report'.
- Cloud: A fix to improve the auto registration of the cmon-cloud binary and improved logging. This also requires a new version of cmon-cloud (new build coming soon).
2018-12-29 clustercontrol-1.7.1-5622, clustercontrol-notifications-1.7.1-159
Frontend
- MySQL Galera: Fix 'Add Node' regression where the template file was not set in the job specification.
- Prevent cmon-events to crash if cmon is not running.
ClusterControl v1.7.1
2018-12-21 clustercontrol-controller-1.7.1-2854, clustercontrol-1.7.1-5617, clustercontrol-cloud-1.7.1-163, clustercontrol-notifications-1.7.1-157, clustercontrol-ssh-1.7.1-70, clustercontrol-cmonapi-1.7.1-338In this release we have primarily continued to add improvements to our agent based monitoring dashboards and PostgreSQL.
Feature Details
Agent Based Monitoring
- Install/enable Prometheus exporters on your nodes and hosts with MySQL, PostgreSQL and MongoDB based clusters.
- Customize collector flags for the exporters (Prometheus). This allows you for example to disable collecting from MySQL's performance schema if you experience load issues on your server.
- Supported Exporters:
- Node/host metrics
- Process - /proc metrics
- MySQL server metrics
- PostgreSQL metrics
- ProxySQL metrics
- HAProxy metrics
- MongoDB metrics
- Dashboards:
- System Overview
- Cluster Overview
- MySQL Server - General
- MySQL Server - Caches
- MySQL InnoDB Metrics
- Galera Cluster Overview
- Galera Server Overview
- PostgreSQL Overview
- ProxySQL Overview
- HAProxy Overview
- MongoDB Cluster Overview
- MongoDB ReplicaSet
- MongoDB Server
Backup
- Create a cluster from an existing backup with MySQL Galera or PostgreSQL.
PostgreSQL
- Query Monitoring improvements - View query statistics:
- Access by sequential or index scans
- Table I/O statistics
- Index I/O statistics
- Database Wide Statistics
- Table Bloat And Index Bloat
- Top 10 largest tables
- Database Sizes
- Last analyzed or vacuumed
- Unused indexes
- Duplicate indexes
- Exclusive lock waits
- Verify/restore backup on a standalone host.
- Create a cluster from an existing backup.
- Support for PostgreSQL 11. Deploy and import clusters.
MongoDB
- Support to deploy/import and manage MongoDB Inc v4.0
Misc
- New license format. Please contact sales@severalnines.com for a new license.
- Continuing moving ExtJS pages to AngularJS. This time the load balancer and nodes page.
- UI logging for troubleshooting web application issues.
- ClusterControl Backup/Restore -This feature can be used to migrate a setup from one controller to another controller. Backup the meta data of an entire controller or individual clusters from the s9s CLI. The backup can then be restored on a new controller with a new hostname/IP and the restore process will automatically recreate database access privileges.
ClusterControl v1.7.0
2018-12-21 clustercontrol-controller-1.7.0-2962
Controller
- Bugfix for SSH connection negotiation failure on compression methods.
- Added support for MaxScale 2.3
- Exporters: New process_exporter version (0.10.10)
- Error Reporting: s9s_error_reporter -i0 collects all config files under /etc/cmon.d/
2018-12-12 clustercontrol-1.7.0-5548, clustercontrol-controller-1.7.0-2939
Frontend
- Keepalived: Fixed an issue where it was listed as a 'master' in the Cluster Node bar.
- Fixed an issue when the replication slaves of a Galera cluster was not shown under 'Show Server's
- Config Mgmt: Removed the Configuration -> Template item as it is deprecated in its current form.
Controller
- Error Report: Fixed an issue where passwords was not masked.
- Deploy Mongodb: Fixed signing keys issues for APT/YUM repos.
2018-12-10 clustercontrol-controller-1.7.0-2930
Controller
- HAProxy: A fix to remove /dev/shm/proxyoff file when promoting a slave or rebuilding a slave.
2018-12-07 clustercontrol-controller-1.7.0-2928
Controller
- PostgreSQL: Double-check if slave has properly configured the 'trigger_file' option in recovery.conf.
- Fixed and issue with wrong owner of the stagingDir (~/s9s_tmp)
- Updated a mongodb.org repo key (replaced the key Richard Kreuter <richard@10gen.com>, with MongoDB 3.4 Release Signing Key <packaging@mongodb.com>
- ProxySQL: properly handling # when handling the monitor and admin users passwords.
2018-11-27 clustercontrol-1.7.0-5455 clustercontrol-controller-1.7.0-2904
Frontend
- PHP Sessions fix for PHP v5.3 and earlier: Added the possibility to fallback to previous filebased session handling. If you experience UI issue please set:
define(' SESSIONS_FALLBACK', true);
in /var/www/html/clustercontrol/bootstrap.php and reload the page. - Backup: Fixed an issue with cron schedule validation in Scheduled Backups.
- Dashboards: Minor optimizations and re-organization of some dashboards.
Controller
- Galera: Clone cluster did not handle default datadir and wsrep_cluster_name for cloning
- Backup: Backup dir starting with /sys can't be removed, fixed a security check.
- Error Reporting: skip GRA* files from error report.
- Operational Reports: system report: Customizable graphs interval (in days unit)
- Operational Reports: changed title from 'Daily System Report' to 'System Report'
- Fixed a bug escaping passwords.
2018-11-13 clustercontrol-1.7.0-5375 clustercontrol-controller-1.7.0-2876
Frontend
- Fixed an issue with PHP session management on PHP 5.3 and earlier. This manifested itself as e.g the Node page was loading forever, no data in the UI and "Internal Error".
Controller
- Backup [mariabackup/xtrabackup]: Clean up qpress archives after restoring an xtrabackup|mariabackup compressed backup
- Verify Backup [mariabackup/xtrabackup]: Fixed a regression where the wrong restore method was selected.
2018-10-30 clustercontrol-controller-1.7.0-2859
Controller
- Deploy/Import Cluster: Fixed an issue to allow \ (backslash) in the admin user password (mysql root password).
2018-10-30 clustercontrol-controller-1.7.0-2854, clustercontrol-1.7.0-5319, clustercontrol-cloud-1.7.0-154, clustercontrol-notifications-1.7.0-153, clustercontrol-ssh-1.7.0-66
Frontend
- Keepalived: Added a fix to show the role, i.e which keepalived node that has the VIP assigned.
- Deploy: Added dot, space and / as allowed symbols for the password field.
- ProxySQL: corrected use of proxysql match digest/pattern fields
- General: Improved session handling.
- SSE (Server Side Events): Improvements to show notifications.
- OS service files fixes to handle non English locales for cmon-cloud, cmon-events, and cmon-ssh.
Controller
- Backup: Restore backup on a Galera cluster (mariabackup/xtrabackup) to a single node shuts down whole cluster even if bootstrap cluster was disabled.
- Backup: mariabackup qpress support.
- Backup: Increased the size of the backup record (TEXT -> MEDIUMTEXT )
- Backup: Fail early if an attempt is made to take an xtrabackup on a MariaDb 10.3 server, and warn if xtrabackup is attempted on the MDB 10.2 series. Using mariabackup on 10.2 and 10.3 is recommended.
- Backup: Verification now supports --use-memory option
- Deploy / MariaDb 10.3: Fix buggy galera_new_cluster (https://jira.mariadb.org/browse/MDEV-17379)
- Galera: Fixed an issue with rebuilding node from the backup.
- Galera/Replication: Fixed an issue preventing a node from being rebuilt if only mariabackup was available on the node. Also improved error messages.
- Keepalived: Added information which node has the VIP assigned
2018-10-19 clustercontrol-1.7.0-5281
Frontend
- Add Node with 'Rebuild from backup': Fix wrong backup id parameter in the job spec.
- Add Node: Moved rebuild backup dropdown.
- Mail server configuration: Fix invalid port length.
- Rebuild from backup: Fix to only show successful backups in the dropdown.
- Removed xtrabackup option from MariaDB v10.3 clusters since it's no longer working with v10.3.
2018-10-16 clustercontrol-controller-1.7.0-2832
Controller
- MariaDb: Fixed an issue with rebuild replication slave to support MariaDb Backup.
- Configuration Management: Fixed an issue preventing to assign decimal values to a database variable.
2018-10-10 clustercontrol-1.7.0-5259 | clustercontrol-controller-1.7.0-2825
Frontend
- SSE (Server Side Events): Fixed when a toaster was shown prompting configuration suggestions when a security token is invalid.
- Advisors: Fixed an issue with importing of advisors and the overwrite flag was not respected.
- Cloud: Fixed and issue with subnets and AZs
- Backup: Added 'MySQL Db Only' as a dump type for mysqldump. This creates a dump of only the mysql database.
Controller
- General: Fixed an issue to chown a dir only if ClusterControl created it.
- Advisors: A fix to properly handle multiple partitions in s9s/host/disk_space_usage.js.
- MongoDb: Fixed an issue where a stepDown was attempted on a shard router (mongos), and the restart node job failed.
- Prometheus: Fail install if a running Prometheus server is detected.
- Prometheus: Updates to queries and optimisations.
- Postgres: Fixed an issue when deploying 9.2.
- Galera: Fixed a bug where the desync node did not work when using MariaDb Backup.
- MySQL Replication: Fixed a bug when the node got the wrong node status after a restart.
2018-09-26 clustercontrol-1.7.0-5224 | clustercontrol-controller-1.7.0-2798
Frontend
- Nodes Page: Fixed a regression with the node charts where the last four graphs had "no data points".
- User Management: Fixed a navigational issue making the Clusters list show up as empty.
- Events (Server Side): Fixed an configuration issue regarding CMON events notifications, which could lead to a 'Enable Events' dialog showing up too frequently.
Controller
- Operational Reports: Fixed an issue where the cluster type in the operational reports was missing.
- Operational Reports: Fixed an issue where the creation of operational reports could deadlock.
- Deploy (MySQL based setups): Fixed a deployment issue where a sanity check failed to determine if percona-xtrabackup was successfully installed.
- MongoDb: Fixed an issue with configuration file handling when mongos and mongod's are colocated.
- Prometheus: A couple of minor optimisations to queries (improved filtering of disk device/fs)
- ProxySQL: Fixed an installation issue on LXD containers.
2018-09-24
clustercontrol-1.7.0-5208
clustercontrol-controller-1.7.0-2792
clustercontrol-cmonapi-1.7.0-333
clustercontrol-cloud-1.7.0-147
clustercontrol-ssh-1.7.0-62
clustercontrol-notifications-1.7.0-139
In this release we are introducing support for agent based monitoring with Prometheus (open-source systems monitoring and alerting system). Enable your cluster to use Prometheus exporters to collect metrics on your nodes and hosts. Avoid excessive SSH activity for monitoring and metrics collections and use SSH connectivity only for management operations.
You can use a set of new dashboards that uses Prometheus as the data source and gives access to its flexible query language and multi-dimensional data model with time series data identified by metric name and key/value pairs. In future releases we will be adding more features such as allowing you to create and import your own dashboards.
We have also a new security feature to enable Audit Logging for MySQL based clusters. Enable policy-based monitoring and logging of connection and query activity executed on your MySQL servers.
Finally we have added support to easily scale out your cloud deployed clusters by automating the cloud instance creation for the new DB node.
Feature Details
Agent Based Monitoring
- Install a Prometheus v2.3.x server on a specified host.
- Install/enable Prometheus exporters on your nodes and hosts with MySQL and PostgreSQL based clusters.
- Supported Exporters:
- Node/machine metrics
- Process - /proc metrics
- MySQL server metrics
- PostgreSQL metrics
- ProxySQL metrics
- New dashboards:
- Cross Server Graphs
- System Overview
- MySQL Overview
- MySQL Replication
- MySQL Performance Schema
- MySQL InnoDB Metrics
- Galera Cluster Overview
- Galera Graphs
- PostgreSQL Overview
- ProxySQL Overview
Security
- Enable/disable Audit Logging on your MySQL based clusters. Enable policy-based monitoring and logging of connection and query activity.
Cloud
- Cloud Scaling. Automatically launch cloud instances and add nodes to your cloud deployed clusters.
Misc
- Support for MariaDB v10.3
- New 'demote master to slave' action for MySQL replication clusters.
- Customize the timezone for dates and time shown across the application.
- UI toasters/notifications for CMON events and alarms. Enables 'Server Sent' events to be sent to the web application for a more dynamic updated user interface.
- Improved workflow to enable PITR for PostgreSQL.
- Added performance graphs for ProxySQL hosts.
Changes in ClusterControl v1.6.2
2018-09-14 clustercontrol-1.6.2-5148 | clustercontrol-controller-1.6.2-2769
Controller
- Backup (MariaDB Backup): Use mbstream instead of xbstream. This removes the dependency to the Percona Xtrabackup package.
- Advisors (MySQL): Improved TimeZone advisor to check if the timezones on the MySQL servers are aligned. This fixes an issue with e.g CET and CEST timezone which are from MySQL's perspective treated the same
- Backup (Verify Backup): Fixed an issue regarding connectivity. Now the Verify Backup does not rely on the MySQL system database tables from cluster db node to perform the verification. This removes the need for a port (9999 by default) to be open between the cluster node(s) and the backup verification server.
- Job handling: Improved parallelism.
Frontend
- MaxScale: Fixed an issue in password validation
- ACLs: Fixed a number of issues in ACL handling.
2018-08-27 clustercontrol-controller-1.6.2-2726
Controller
- ProxySQL: Fixed an issue with Sync Instance preventing query rules to become active on target instance.
- Backup (MariaDB Backup): Fixed an issue where the incorrect encryption options were passed to Maria Backup.
- Backup (Percona XtraBackup/MariaDB Backup): Fixed the order so that backups are first compressed and then encrypted resulting in smaller backup sizes.
- Galera: Fixed a bug in 'Clone Cluster' which ignored the 'sudo' password (if set) leading to failed cloning.
2018-08-21 clustercontrol-1.6.2-5025 clustercontrol-controller-1.6.2-2718
Frontend
- Fix broken Re-sync Node from backup (MySQL Galera).
- Misc ACL privileges fixes to Deployments, Activity Viewer, Left Side Navigation, and default user.
- Correctly handle empty responses on the User Management page.
Controller
- Backup: Fixed an issue with parallel backups when executed on the controller.
- Backup: A fix to recreate the backup user with the proper privileges.
- ProxySQL: Fixed an issue with broken stats (e.,g the 'Questions' was not properly accounted for).
- ProxySQL: Fixed an issue with version detection (added fallbacks).
- PostgreSQL: Added support for creating user entries with masks other than /32 via s9s cli.
- PostgreSQL: Fixed an issue with connection errors from HAProxy to PostgreSQL with IPv6.
- Replication: Failover scripts did not get executed.
- MongoDb: Updated the repo key.
2018-07-23 clustercontrol-1.6.2-4959
Frontend
- Fix copy and paste in the Query Monitor (PostgreSQL)
- Show trimmed query in full for Query Monitor (PostgreSQL)
- Fix dialog labels for AppArmor/SELinux
- Partial backup warning only for xtrabackup/mariadbbackup
- Security page is currently only for MySQL/PostgreSQL and fixes for use existing certificates
ClusterControl v1.6.2
2018-07-16
clustercontrol-1.6.2-4942
clustercontrol-controller-1.6.2-2662
clustercontrol-cmonapi-1.6.2-330
clustercontrol-cloud-1.6.2-141
clustercontrol-ssh-1.6.2-59
clustercontrol-notifications-1.6.2-136
Welcome to our new 1.6.2 release!
Feature Details
Backup
- Continuous Archiving and Point-in-Time Recovery (PITR) for PostgreSQL.
- Rebuild a node from a backup with MySQL Galera clusters to avoid SST.
- Option to restore external backups stored on a DB node (instead of only the Controller host).
MySQL/Galera
- Rebuild a Galera node from a backup to avoid SST.
Security
- Consolidate security functionality on an easily accessible single page.
- Enable/Disable:
- Client/Server SSL encryption for MySQL based clusters.
- SSL replication traffic encryption for MySQL Galera based clusters.
- Transparent Data Encryption (MySQL). Coming soon!
- Audit Logging (MySQL). Coming soon!
ProxySQL
- Clear/Reset Top Queries.
- Advanced query rules options: Error and OK messages, sticky connection and multiplex.
- Autofill match digest for a query rule.
Cloud
- Destructive actions now cleanup used cloud resources (accounting).
- Support for scaling DB nodes by automating cloud instance provisioning. Coming Soon!
- Support for load balancers. Coming Soon!
- Support for MySQL Replication clusters. Coming Soon!
Misc
- ClusterControl (CMON) Runtime Configuration page.
- Support for MongoDB v3.6.
Changes in ClusterControl v1.6.1
2018-07-04 clustercontrol-1.6.1-4896
Frontend
- Identical host charts fix for SQL and Data Nodes with MySQL Cluster (NDB).
- 'DB User Management' fix with MySQL Cluster (NDB). Create and edit DB users works again.
2018-06-28 clustercontrol-controller-1.6.1-2621
Controller
- MariaDB: Deployment fix caused by a mix up of authentication_string and password in the mysql.user table.
- Restore slaves/Rebuild nodes [MySQL, Postgres] Making the directory of the datadir backup configurable. Specify 'datadir_backup_path' in /etc/cmon.d/cmon_X.cnf. By default the datadir will be copied (after the server has been shutdown, but before restoring/rebuilding) using a filesystem copy to {datadir}_bak.
- Error reporting: A fix to also include the include files of a database node configuration file.
- Alarms: Fixed an issue when the measured value was a NaN or INF.
- MySQL: Add Node could fail due to a bug in version detection.
- General: A fix allowing other jobs to run in parallel with remove cluster jobs.
2018-06-26 clustercontrol-1.6.1-4865
FE
- Remove the default 0 sized cc-ldap.log file from the package overwriting the existing ldap log file.
2018-06-15 clustercontrol-1.6.1-4848 | clustercontrol-controller-1.6.1-2605 | clustercontrol-notifications-111
FE
- Fix schedule backup verification with mysqldump.
- Fix empty configuration template dropdown for add node (MySQL Galera).
- Fix to allow controller host timezone when scheduling maintenance mode.
- Fix for the schedule maintenance mode dialog closing immediately.
- Fix stuck scrolling with the PostgreSQL advisor's page.
- Fix missing validation for the xtrabackup --use-memory option.
- Add 'Lock DDL per table 'option for xtrabackup.
- Fixes to cmon-events to handle filtering correctly.
Controller
- Alarms/Notifications: Fixed a bug refreshing alarm thresholds. This prevented user specified thresholds in cmon_X.cnf from being applied.
- Mongo: Adding numa node number check before installing or using numactl for mongo.
- PostgreSQL host granting (pg_hba) fixed
- PostgreSQL: show error log when node failed to start.
- PostgreSQL: fixed an issue with pg_hba file error when using IPv6
- PostgreSQL/HAProxy: HAProxy did not refresh postgres node state after rebuild of a slave.
- ProxySQL: Include more data in the error report.
- ProxySQL: Adding sanity check on admin port for registering existing proxysql node.
- ProxySQL: Updated ProxySQL galera checker script to use 1.4.8
- Galera: Fixed a crashing bug in case of missing wsrep_sst_auth
- Maxscale: Fixed so that the software will not be installed if it is already installed on the node.
Events/Notifications
- Fixed a bug which ignored the configured filter. This caused e.g a Warning alarm to create a notification, when only Critical was configured.
ClusterControl v1.6.1
2018-05-25
clustercontrol-1.6.1-4801 | clustercontrol-controller-1.6.1-2572
clustercontrol-cmonapi-1.6.1-324 | clustercontrol-notifications-1.6.1-94
clustercontrol-cloud-1.6.1-121 | clustercontrol-ssh-1.6.1-53
Feature Details
Backup
- Support for MariaDB Backup for MariaDB based clusters. MariaDB Server 10.1 introduced MariaDB Compression and Data-at-Rest Encryption which is supported by MariaDB Backup (a fork of Percona XtraBackup).
- Support for Schema(--no-data) or Data(--no-create-info) only backups and skipping extended insert(--skip-extended-insert) with mysqldump.
- Support for --use-memory with xtrabackup.
- Support for custom backup subdirectory names:
- Set the name of the backup subdirectory. This string may hold standard "%X" field separators, the "%06I" for example will be replaced by the numerical ID of the backup in 6 field wide format that uses '0' as leading fill characters.
- Default value: "BACKUP-%I"
- B - The date and time when the backup creation was beginning.
- H - The name of the backup host, the host that created the backup.
- i - The numerical ID of the cluster.
- I - The numerical ID of the backup.
- J - The numerical ID of the job that created the backup.
- M - The backup method (e.g. "mysqldump").
- O - The name of the user who initiated the backup job.
- S - The name of the storage host, the host that stores the backup files.
- % - The percent sign itself. Use two percent signs, "%%" the same way the standard printf() function interprets it as one percent sign.
PostgreSQL
- Synchronous Replication Slaves.
- Multiple NICs support:
- Deploy DB nodes using management/public IPs for monitoring connections and data/private IPs for replication traffic.
- Deploy HAProxy using management/public IPs and private IPs for configurations.
Misc
- ServiceNow has been added as a new notifications integration.
- Support for MaxScale 2.2.
- Database User Management (MySQL) can now search/filter accounts on username, hostname, schema or table.
- Node page graphs are now showing accurate time ranges and datapoint gaps.
- Query Monitoring is using the CMON RPC API.
- Database Growth is using the CMON RPC API.
- Support for PHP 7.2 with an upgraded CakePHP version 2.10.9
Changes in ClusterControl v1.6.0
2018-05-18 clustercontrol-controller-1.6.0-2553
Controller
- PostgreSQL: Support for init scripts for RHSCL PosrgreSQL packages. Please note that further tuning of the environment may be needed.
- PostgreSQL: Improved logic to locate the Postgres log files.
- PostgreSQL: Verifying the configuration and listen_addresses before registering the node.
- PostgreSQL: Better error reporting in case of connection timeouts.
- PostgreSQL: Improvements and better messaging of slave recovery in case of the host being down.
- MySQL/Galera: Properly handle quoted 'wsrep_sst_auth' entries.
- Backup: Running a backup prevented other jobs from being executed.
- Backup: A fix to prevent a backup to be uploaded to the cloud when the user did not ask for it.
- Error reporting: A fix for 'Access denied' when S9s CLI created a user.
- General: Removed the printout 'RPC: No variables available for...'.
2018-05-17 clustercontrol-1.6.0-4767
FE
- Fix to add missing admin port option for ProxySQL installations and registrations.
- Fix replication lag not shown properly for MySQL Replication clusters.
- Fix to allow changing the default region with a cloud credential.
- Fix to restart a failed PostgreSQL job.
2018-05-07 clustercontrol-notifications-1.6.0-88
FE
- Bump version of clustercontrol-notifications to 1.6.0.
2018-05-07 clustercontrol-cloud-1.6.0-115
FE
- Fix an issue with the security group on AWS preventing cloud deployment to work if ClusterControl was installed in the same VPC.
2018-05-04 clustercontrol-1.6.0-4699
FE
- Security Vulnerability: Fixed an issue where it was possible to perform a XSS attack.
- Cloud Deployments: Fixed a missing validation of the SSH Key.
- LDAP: Add support to get the user group from a 'memberof' attribute
2018-05-02 clustercontrol-controller-1.6.0-2514 | clustercontrol-1.6.0-4682 | clustercontrol-cmonapi-1.6.0-310
FE
- LDAP: Fix an issue preventing users to login with anything else than an email address.
- Changed default basedir to /usr for MySQL Cluster (NDB) import.
- Fix for an issue where a failed ProxySQL node was added and then not removable.
- Fix for and issue with a blank page with DB User Management when default anonymous users (test users) are detected.
- Add validation when trying to use reserved words with PostgreSQL deployments.
- Tune the custom advisor dialog for lower resolution screens.
- Fix an regression preventing error reports from being created from the frontend.
Controller
- NDB Cluster: SELinux settings were not checked correctly.
- NDB Cluster: The Install Software option was not respected.
- NDB Cluster: Fixed an issue detecting disk space and calculating the size of the REDO log.
- Postgres: Add Replication Slave will fail if there is an existing Postgres server running on the node, and also check if the psql client is available.
- PostgreSQL: Forbid using reserved SQL keywords as PostgreSQL username (as it is an identifier there which can not be a reserved keyword).
- Backup (xtrabackup): Fixed an issue where an Incremental backup could be created without having a Full backup. Now the following will happen: If there is no Full backup, the Incremental backup will be executed as a Full backup.
- MaxScale: Version 2.2.x support.
ClusterControl v1.6.0
2018-04-17 clustercontrol-controller-1.6.0-2493 | clustercontrol-1.6.0-4567 | clustercontrol-cmonapi-1.6.0-303 | clustercontrol-cloud-1.6.0-104 | clustercontrol-ssh-1.6.0-44
Welcome to our new 1.6.0 release! Restoring your database using only a backup for disaster recovery is at times not enough. You often want to restore to a specific point in time or transaction after the backup happened.
You can now do Point In Time Recovery - PITR for MySQL based databases by passing in a stop time or an event position in the binary logs as a recovery target.
We are also continuing to add cloud functionality:
- Launch cloud instances and deploy a database cluster on AWS, Google Cloud and Azure from your on-premise installation.
- Upload/download backups to Azure cloud storage.
Our cluster topology view now supports PostgreSQL replication clusters and MongoDB ReplicaSets and Shards. Easily see how your database nodes are related to each other and perform actions with intuitive drag and drop motion.
As in every release we continously work on improving our UX/UI experience for our users. This time around we have re-designed the DB User Management page for MySQL based clusters.
It should be easier to understand and manage your database users with this new user interface.
Let us know what you think about these features and changes anytime at cc-feedback!
Feature Details
Point In Time Recovery - PITR (MySQL)
- Position and timebased recovery for MySQL based clusters.
- Recover until the date and time given by Restore Time (Event time - stop date&time).
- Recover until the stop position is found in the specified binary log file. If you enter binlog.001827 it will scan existing binary logs files until binlog.001827 (inclusive) and not go any further.
Deploy and manage clusters on public Clouds (BETA)
Supported cloud providers
- Amazon Web Services (VPC), Google Cloud, and Azure.
Supported databases:
- MySQL Galera, PostgreSQL, MongoDB ReplicaSet
- Current limitations:
- There is currently no 'accounting' in place for the cloud instances. You will need to manually remove created cloud instances.
- You cannot add or remove a node automatically with cloud instances.
- You cannot deploy a load balancer automatically with a cloud instance.
Topology View
Support added for:
- PostgreSQL Replication clusters.
- MongoDB ReplicaSets and Sharded clusters.
Misc
- Improved cluster deployment speed by utilizing parallel jobs. Deploy more than one cluster in parallel.
- Re-designed DB User Management for MySQL based clusters.
- Support to deploy and manage MongoDB cluster on v3.6
Comments
5 comments
Hi Vinay,
Thanks for these changelog and bugfixes/improvements, very pleased to see this new release with a clear Changelog and some instructions on how to upgrade !!
Thanks a lot guys for this good work ;)
Regards,
Laurent
Hello team,
I have been experiencing issues with stanza on postgres just before you release the fix.
PostgreSQL: Fixed an issue with PgBackRest
Can you please provide more details up on this fix?
You are excluding the user managed stanzas, or you are excluding the options for stanza and overriding the setting set manually. Also I am interested if such kind of issues are really out of support with the older versions of CC. :) I am using CC i order to minimize the support of this database and not getting into database administration.
Thanks in advance!
Teodor
Hi Teodor,
What it means on this is that if a user specifies a custom stanza name, then when performing a pgbackrest, that will instead be used and not the clustercontrol generated one.
I suggest you raise a Zendesk ticket instead for more deeper question related to this.
Thanks Teodor.
Thank you for both reporting this error and your prompt elimination. I think you should post such news on Twitter, because I think all users of your site use this social network and it allows you to quickly find out such news. I have enough chatso to observe there similar tweets from other companies and I noticed that even more often they post accounts with almost 44 thousand subscribers! I am sure this is because the owners of these accounts use the services of https://soclikes.com/buy-twitter-followers in order to wind up subscribers to Twitter.
Thanks for sharing the valuable information.
voice engineering
Please sign in to leave a comment.