Can't monitor nodes performance after upgrading CMON from 1.2.8 to 1.2.9

Follow

Diptin Patel

• February 17, 2015 21:38

I'm running Galera MySQL Cluster on Redhat Ent 6.5. I performed an upgrade this afternoon from 1.2.8 to 1.2.9 and now unable to see any performance on any of the cluster nodes. All graphs are stuck in loading state and while it's fetching data. 

I'm able to SSH to all nodes from the controller. Status of all 3 nodes are being reported OK. 

I noticed this error under logs:

Error exporting configurations: Error opening '/root/s9s_tmp/1/galera/config/my.cnf.esbdb1.reg.*.*.ca': No such file or directory. Exit Code: 1 30 17 Feb 2015 14:45:58 Started Exit Code: 0 30 17 Feb 2015 14:45:58 Export configuration to nodes. Exit Code: 0 30 17 Feb 2015 14:45:58 Message sent to controller Exit Code: 0

0

• 

  Ashraf Sharif

  • February 19, 2015 02:40

  Hi Diptin,

  How did you perform the upgrade? Did you follow the instructions here: http://support.severalnines.com/entries/21095371-CMON-1-2-9-released-upgrade-instructions

  ClusterControl 1.2.9 requires port 9500 to be opened on ClusterControl node.

  Regards,

  Ashraf

  0

  Comment actions Permalink
• 

  Diptin Patel

  • February 19, 2015 16:14

  Hi Ashraf,

  
  Yes I followed the same documentation for upgrade. For applying the schema, I omitted steps to update from 1.2.6 to 1.2.8, since I was already at 1.2.8.

   

  I applied following schemas.

  mysql -f -h127.0.0.1 -ucmon -p cmon < /usr/share/cmon/cmon_db.sql

  mysql -f- h127.0.0.1 -ucmon -p cmon < /usr/share/cmon/cmon_db_mods-1.2.8-1.2.9.sql
  
  mysql -f -h127.0.0.1 -ucmon -p cmon < /usr/share/cmon/cmon_data.sql

   

   

  However, Alex was able to assist me with this incident. I had another ticket open with similar issue.

   

  I’m still having one small issue though. It’s a 3 node cluster, and cluster is online (with 3 nodes) and active under overview tab, but under Nodes tab I’m missing 3^rd node and it’s has following message:

   

  Node is OK

  Cluster has an even number of Galera nodes. Add a garbd (Galera arbitrator), another node or remove a node to have an odd number number of nodes.

   

  Can you please assist with this? I tried added the 3^rd node, but it failed.
  
  Thanks,

  Diptin

  0

  Comment actions Permalink
• 

  Ashraf Sharif

  • February 19, 2015 17:05

  Hi Diptin,

  What is the output of following statements on ClusterControl node?

  mysql -u root -p cmon -e 'select * from mysql_server'

  mysql -u root -p cmon -e 'select * from hosts'

  Also please also send the output of following command:

  grep mysql_server_addresses /etc/cmon.cnf

   ** If it returns nothing, replace /etc/cmon.cnf with /etc/cmon.d/cmon_<cluster_id>.cnf

  Regards,

  Ashraf

  0

  Comment actions Permalink

Please sign in to leave a comment.