Constant hanging of wsrep in pre-commit stage and Preparing for TO isolation Happening Now
| 2838440 | gtowrite | 10.1.105.42:48732 | gtocdr | Query | 42497 | wsrep in pre-commit stage | LOAD DATA LOCAL INFILE '/opt/www/gtoweb/dataimport/axecdr/med/ecdrsmall' INTO TABLE ecdrsmall FIELD | 0 | 0 |
| 2840329 | stsadmin | 10.1.105.42:51587 | axe_sts | Query | 40634 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090300_6000/APDIS | 0 | 0 |
| 2841538 | gtowebii | 10.1.105.42:53436 | gtowebii | Query | 34906 | wsrep in pre-commit stage | INSERT INTO `stationlog_main` (`subsystem_id`, `component_id`, `subcomponent_id`, `device_id`, `mtts | 0 | 0 |
| 2843947 | stsadmin | 10.1.105.42:57107 | axe_sts | Query | 36979 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090300_6000/APPLA | 0 | 0 |
| 2845549 | gtowebii | 10.1.105.42:59526 | gtowebii | Sleep | 2994 | | NULL
| 1481 | 1481 |
| 2847046 | gtowrite | 10.1.105.42:61803 | gtoauth | Query | 33962 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'croberts', 'S')
| 0 | 0 |
| 2848305 | gtowebii | 10.1.105.42:63683 | gtowebii | Query | 6708 | wsrep in pre-commit stage | INSERT INTO `stationlog_main` (`subsystem_id`, `component_id`, `subcomponent_id`, `device_id`, `mtts | 0 | 0 |
| 2848387 | gtowebii | 10.1.105.42:63808 | gtowebii | Sleep | 1406 | | NULL
| 1481 | 1481 |
| 2848691 | mda | 10.1.105.42:64270 | mda | Query | 32344 | wsrep in pre-commit stage | INSERT INTO sessions (session_user, lasthit, session_ip, session_cookieval) VALUES ('881621473426', | 0 | 0 |
| 2849414 | stsadmin | 10.1.105.42:1373 | axe_sts | Query | 31626 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090315_6001/APDIS | 0 | 0 |
| 2851232 | stsadmin | 10.1.105.42:4101 | axe_sts | Query | 29783 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090315_6001/APPLA | 0 | 0 |
| 2852178 | stsadmin | 10.1.105.42:5488 | axe_sts | Query | 28821 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090315_6001/AUCMA | 0 | 0 |
| 2853017 | gtowrite | 10.1.105.42:6767 | gtocdr | Query | 28098 | wsrep in pre-commit stage | LOAD DATA LOCAL INFILE '/opt/www/gtoweb/dataimport/axecdr/med/ecdrsmall' INTO TABLE ecdrsmall FIELD | 0 | 0 |
| 2854943 | stsadmin | 10.1.105.42:9690 | axe_sts | Query | 26026 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090315_6001/AUCSU | 0 | 0 |
| 2855968 | stsadmin | 10.1.105.42:11215 | axe_sts | Query | 24973 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090315_6001/AUTHE | 0 | 0 |
| 2857642 | stsadmin | 10.1.105.42:13735 | axe_sts | Query | 23263 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090315_6001/AUTHS | 0 | 0 |
| 2858007 | gtowrite | 10.1.105.42:14277 | gtoauth | Query | 23162 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'croberts', 'S')
| 0 | 0 |
| 2858342 | gtowebii | 10.1.105.42:14767 | gtowebii | Sleep | 1233 | | NULL
| 15 | 30 |
| 2859484 | stsadmin | 10.1.105.42:16476 | axe_sts | Query | 21716 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/APDIS | 0 | 0 |
| 2861390 | stsadmin | 10.1.105.42:19348 | axe_sts | Query | 19782 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/APPLA | 0 | 0 |
| 2862241 | stsadmin | 10.1.105.42:20637 | axe_sts | Query | 18881 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/AUCMA | 0 | 0 |
| 2863122 | stsadmin | 10.1.105.42:21958 | axe_sts | Query | 17959 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/AUCSU | 0 | 0 |
| 2863414 | stsadmin | 10.1.105.42:22392 | axe_sts | Query | 17623 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/AUTHE | 0 | 0 |
| 2864030 | stsadmin | 10.1.105.42:23324 | axe_sts | Query | 16956 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/AUTHS | 0 | 0 |
| 2865388 | stsadmin | 10.1.105.42:25353 | axe_sts | Query | 15567 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/BSCST | 0 | 0 |
| 2866096 | stsadmin | 10.1.105.42:26426 | axe_sts | Query | 14808 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/CHASS | 0 | 0 |
| 2867092 | stsadmin | 10.1.105.42:27929 | axe_sts | Query | 13765 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/DIGPA | 0 | 0 |
| 2868820 | stsadmin | 10.1.105.42:30518 | axe_sts | Query | 12004 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/DTIST | 0 | 0 |
| 2869492 | stsadmin | 10.1.105.42:31514 | axe_sts | Query | 11805 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/APDIS | 0 | 0 |
| 2869522 | gtowrite | 10.1.105.42:31559 | gtoauth | Query | 11777 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'cwalker', 'S')
| 0 | 0 |
| 2870391 | stsadmin | 10.1.105.42:32877 | axe_sts | Query | 10854 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/APPLA | 0 | 0 |
| 2872318 | stsadmin | 10.1.105.42:35794 | axe_sts | Query | 8880 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUCMA | 0 | 0 |
| 2873230 | stsadmin | 10.1.105.42:37151 | axe_sts | Query | 7928 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUCSU | 0 | 0 |
| 2874165 | stsadmin | 10.1.105.42:38543 | axe_sts | Query | 6955 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUTHE | 0 | 0 |
| 2874406 | gtowrite | 10.1.105.42:38900 | gtoauth | Query | 6925 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'hflores', 'S')
| 0 | 0 |
| 2874773 | gtowrite | 10.1.105.42:39440 | gtoauth | Query | 6567 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'ktanner', 'S'
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/AUTHE | 0 | 0 |
| 2864030 | stsadmin | 10.1.105.42:23324 | axe_sts | Query | 16956 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/AUTHS | 0 | 0 |
| 2865388 | stsadmin | 10.1.105.42:25353 | axe_sts | Query | 15567 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/BSCST | 0 | 0 |
| 2866096 | stsadmin | 10.1.105.42:26426 | axe_sts | Query | 14808 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/CHASS | 0 | 0 |
| 2867092 | stsadmin | 10.1.105.42:27929 | axe_sts | Query | 13765 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/DIGPA | 0 | 0 |
| 2868820 | stsadmin | 10.1.105.42:30518 | axe_sts | Query | 12004 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/DTIST | 0 | 0 |
| 2869492 | stsadmin | 10.1.105.42:31514 | axe_sts | Query | 11805 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/APDIS | 0 | 0 |
| 2869522 | gtowrite | 10.1.105.42:31559 | gtoauth | Query | 11777 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'cwalker', 'S')
| 0 | 0 |
| 2870391 | stsadmin | 10.1.105.42:32877 | axe_sts | Query | 10854 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/APPLA | 0 | 0 |
| 2872318 | stsadmin | 10.1.105.42:35794 | axe_sts | Query | 8880 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUCMA | 0 | 0 |
| 2873230 | stsadmin | 10.1.105.42:37151 | axe_sts | Query | 7928 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUCSU | 0 | 0 |
| 2874165 | stsadmin | 10.1.105.42:38543 | axe_sts | Query | 6955 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUTHE | 0 | 0 |
| 2874406 | gtowrite | 10.1.105.42:38900 | gtoauth | Query | 6925 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'hflores', 'S')
| 0 | 0 |
| 2874773 | gtowrite | 10.1.105.42:39440 | gtoauth | Query | 6567 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'ktanner', 'S')
| 0 | 0 |
| 2875190 | stsadmin | 10.1.105.42:40061 | axe_sts | Query | 5901 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUTHS | 0 | 0 |
| 2875389 | stsadmin | 10.1.105.42:40353 | axe_sts | Query | 5656 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/BSCST | 0 | 0 |
| 2876755 | stsadmin | 10.1.105.42:42413 | axe_sts | Query | 4242 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/CHASS | 0 | 0 |
| 2877352 | stsadmin | 10.1.105.42:43303 | axe_sts | Query | 3599 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/DIGPA | 0 | 0 |
| 2878410 | stsadmin | 10.1.105.42:44869 | axe_sts | Query | 2506 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/DTIST | 0 | 0 |
| 2878584 | stsadmin | 10.1.105.42:45126 | axe_sts | Query | 2286 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/ECPOO | 0 | 0 |
| 2880384 | stsadmin | 10.1.105.42:47818 | axe_sts | Query | 1005 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090400_6004/APDIS | 0 | 0 |
| 2880390 | stsadmin | 10.1.105.42:47826 | axe_sts | Query | 949 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090400_6004/APPLA | 0 | 0 |
| 2880403 | stsadmin | 10.1.105.42:47847 | axe_sts | Query | 886 | wsrep in pre-commit stage | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090400_6004/AUCMA | 0 | 0 |
| 2881334 | stsadmin | 10.1.105.42:49218 | axe_sts | Query | 25 | System lock | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090400_6004/APPLA | 0 | 0 |
| 2881364 | gtowrite | 10.1.105.42:49264 | gtoauth | Query | 47 | wsrep in pre-commit stage | Insert into loghist(stamp, userid, status) values(now(), 'cbeier', 'S')
| 0
-
On node 3:
| 414015 | stsadmin | 10.1.105.42:34607 | axe_sts | Query | 12660 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090330_6002/ECPOO | 0 | 0 |
| 415780 | stsadmin | 10.1.105.42:37379 | axe_sts | Query | 11340 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/APDIS | 0 | 0 |
| 416646 | stsadmin | 10.1.105.42:38700 | axe_sts | Query | 10415 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/APPLA | 0 | 0 |
| 416683 | stsadmin | 10.1.105.42:38759 | axe_sts | Query | 10327 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUCMA | 0 | 0 |
| 417596 | stsadmin | 10.1.105.42:40203 | axe_sts | Query | 9323 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUCSU | 0 | 0 |
| 418513 | stsadmin | 10.1.105.42:41639 | axe_sts | Query | 8321 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUTHE | 0 | 0 |
| 418702 | stsadmin | 10.1.105.42:41935 | axe_sts | Query | 8075 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/AUTHS | 0 | 0 |
| 419245 | stsadmin | 10.1.105.42:42787 | axe_sts | Query | 7458 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/BSCST | 0 | 0 |
| 419703 | stsadmin | 10.1.105.42:43510 | axe_sts | Query | 6929 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/CHASS | 0 | 0 |
| 420016 | gtowrite | 10.1.105.42:44010 | gtocdr | Query | 6956 | wsrep waiting on replaying | LOAD DATA LOCAL INFILE '/opt/www/gtoweb/dataimport/axecdr/med/ecdrsmall' INTO TABLE ecdrsmall FIELD | 0 | 0 |
| 420108 | stsadmin | 10.1.105.42:44155 | axe_sts | Query | 6452 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/DIGPA | 0 | 0 |
| 420959 | stsadmin | 10.1.105.42:45513 | axe_sts | Query | 5504 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/DTIST | 0 | 0 |
| 421659 | stsadmin | 10.1.105.42:46613 | axe_sts | Query | 4721 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/ECPOO | 0 | 0 |
| 422321 | stsadmin | 10.1.105.42:47664 | axe_sts | Query | 3972 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/EOS.d | 0 | 0 |
| 422674 | stsadmin | 10.1.105.42:48223 | axe_sts | Query | 3602 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/EOS.d | 0 | 0 |
| 424004 | stsadmin | 10.1.105.42:50327 | axe_sts | Query | 2149 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/EQIDC | 0 | 0 |
| 424233 | stsadmin | 10.1.105.42:50694 | axe_sts | Query | 1854 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090345_6003/gener | 0 | 0 |
| 425236 | stsadmin | 10.1.105.42:52294 | axe_sts | Query | 1457 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090400_6004/APDIS | 0 | 0 |
| 425253 | gtowrite | 10.1.105.42:52322 | gtoauth | Query | 1441 | wsrep waiting on replaying | Insert into loghist(stamp, userid, status) values(now(), 'cwalker', 'S')
| 0 | 0 |
| 426112 | stsadmin | 10.1.105.42:53708 | axe_sts | Query | 467 | wsrep waiting on replaying | LOAD DATA LOCAL
INFILE '/var/ose/projects/ericsson_stat/axe_sts/RAW/GW01STS_201509090400_6004/APPLA | 0 | 0 |
| 426496 | root | localhost | NULL | Sleep | 109 | | NULL
| 0 | 0 |
| 426602 | root | localhost | NULL | Query | 0 | init | show processlist -
Hi,
I am not sure how the data files are loaded in, but it seems that they are loaded in parallel on multiple servers.
E.g I see multiple LOAD DATA .. for the table 'ecdrsmall'.
Furthermore, i don't know what the table 'ecdrsmall' look like (DDL).
Is it an INNODB table? (Myisam replication is very )
Does it have a PK?
Do you use TRIGGERS / FOREIGN KEYS ?
I suggest you try and load the data files onto one server only.If you have a Loadbalancer, don't load the files through the LB, instead go directly on one node, and one node only.
BR
johan -
Hi,
Galera itself does not facilitate read/write splitting.
If you dont use a load balancer, then you could just simply connect to one galera node, and then if that galera node fails, failover to another node. But all connections must failover to the same galera node.If you use HAProxy: http://www.severalnines.com/blog/avoiding-deadlocks-galera-set-haproxy-single-node-writes-and-multi-node-reads
BR
johan
Please sign in to leave a comment.
Comments
8 comments