Problem with cluster and can't recovery it

Follow

CoolMan

• January 28, 2025 18:32

Hello! i have cluster with 4 nodes. it's was working wall but today it was stuck with many inser quierys which was waiting for some process. i try to kill all processs on each node of cluster but it's just changed status to killed.

I didn't know how to solve it and stoped all nodes after it i start recovery of cluster made boootstrap from one node. 

But it's stoped on this job https://www.evernote.com/shard/s115/sh/a4feddb5-0f21-41d7-a79a-faee1c4e7ed6/XGTMT1Ub4Bbep06_9SlF44DgbzkPcojRuA1F3aX-MxYXwa-PtqujI8fNzw

[20:02:52]:

192.168.50.17: Stopping the service mariadb.

[20:02:50]:

192.168.50.17: Stopping MySQL service.

[20:02:49]:

192.168.50.17:3306: Stopping mysqld (timeout=120, force stop after timeout=true).

[20:02:49]:

192.168.50.17:3306: Stopping node.

[20:02:49]:

192.168.50.56:3306: Stopped node.

[20:02:45]:

192.168.50.56: All processes stopped.

[20:02:40]:

192.168.50.56: Stopping the service mariadb.

[20:02:38]:

192.168.50.56: Stopping MySQL service.

[20:02:37]:

192.168.50.56:3306: Stopping mysqld (timeout=120, force stop after timeout=true).

[20:02:37]:

192.168.50.56:3306: Stopping node.

[20:02:37]:

Ensuring cluster is stopped.

[20:02:37]:

Setting cluster_autorecovery: false, node_autorecovery: false settings.

[20:02:37]:

Saving cluster_autorecovery: true, node_autorecovery: true settings.

[20:02:37]:

The keyfile is '/root/.ssh/id_rsa'.

[20:02:37]:

The username is 'root'.

[20:02:37]:

The creds name is 'ssh_cred_cluster_3_6245'.

[20:02:37]:

Cluster ID is 3.

[20:02:37]:

Using SSH credentials from cluster.

[20:02:37]:

CMON version 2.3.0.11519.

Can somebody help to resolve this problem ?

0

• Official comment

  

  Krzysztof Ksiazek

  • February 04, 2025 11:17

  Hello,

  It is hard to tell what might be causing this issue. If you encounter any kind of problems, the best way to get some help is to create a ticket via our support portal (support.severalnines.com). All trial environments are entitled to support. When you will be opening a ticket make sure, please, that you include an error report. You can generate it by running

  s9s-error-reporter -i 0 

  on the ClusterControl instance.

  Thanks,
  Krzysztof

  Comment actions Permalink

Please sign in to leave a comment.