Error 2341
Having built a test cluster I shut it all down whilst we worked on our own code to build in jdbc loadbalance support on pwering up the cluster again i get the following errors, any thoughts ?
Node 3: Forced node shutdown completed. Caused by error 2341: 'Internal program error (failed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
Node 4: Forced node shutdown completed. Caused by error 2341: 'Internal program error (failed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
-
Hi,
It would be good to see the error logs for the nodes and the deployment package (too see the config.ini).
The error logs are in the data directory of the data nodes.
You can do
cd mysqlcluster-71/cluster/scripts/tools
./check-ndbd-errlog.sh
Run it for each node.
Post the output here or create a support issue.
Eventually we will also need the trace files later (depends on the error log).
Is this 7.1.19?
Thank you,
johan
-
Hi, Here is the config.ini
[TCP DEFAULT]
SendBufferMemory=2M
ReceiveBufferMemory=2M[NDB_MGMD DEFAULT]
PortNumber=1186
Datadir=/data/mysqlcluster/[NDB_MGMD]
NodeId=1
Hostname=x.x.x.103
LogDestination=FILE:filename=ndb_1_cluster.log,maxsize=10000000,maxfiles=6
ArbitrationRank=1[NDB_MGMD]
NodeId=2
Hostname=x.x.x.104
LogDestination=FILE:filename=ndb_2_cluster.log,maxsize=10000000,maxfiles=6
ArbitrationRank=1[NDBD DEFAULT]
NoOfReplicas=2
Datadir=/data/mysqlcluster/
FileSystemPathDD=/data/mysqlcluster/
BackupDataDir=/data/mysqlcluster//backup/
#FileSystemPathUndoFiles=/data/mysqlcluster/
#FileSystemPathDataFiles=/data/mysqlcluster/
DataMemory=4553M
IndexMemory=570M
LockPagesInMainMemory=1MaxNoOfConcurrentOperations=100000
MaxNoOfConcurrentTransactions=16384StringMemory=25
MaxNoOfTables=4096
MaxNoOfOrderedIndexes=2048
MaxNoOfUniqueHashIndexes=512
MaxNoOfAttributes=24576
MaxNoOfTriggers=14336### Params for REDO LOG
FragmentLogFileSize=256M
InitFragmentLogFiles=SPARSE
NoOfFragmentLogFiles=18
RedoBuffer=32MTimeBetweenGlobalCheckpoints=1000
TimeBetweenEpochs=100TimeBetweenEpochsTimeout=0
### Params for LCP
DiskCheckpointSpeedInRestart=100M
DiskCheckpointSpeed=10M
TimeBetweenLocalCheckpoints=20### Heartbeating
HeartbeatIntervalDbDb=15000
HeartbeatIntervalDbApi=15000### Params for setting logging
MemReportFrequency=30
BackupReportFrequency=10
LogLevelStartup=15
LogLevelShutdown=15
LogLevelCheckpoint=8
LogLevelNodeRestart=15### Params for BACKUP
BackupMaxWriteSize=1M
BackupDataBufferSize=16M
BackupLogBufferSize=4M
BackupMemory=20M### Params for ODIRECT
#Reports indicates that odirect=1 can cause io errors (os err code 5) on some systems. You must test.
#ODirect=1### Watchdog
TimeBetweenWatchdogCheckInitial=60000### TransactionInactiveTimeout - should be enabled in Production
TransactionInactiveTimeout=60000
### New 7.1.10 redo logging parameters
RedoOverCommitCounter=3
RedoOverCommitLimit=20
### REALTIME EXTENSIONS
#RealTimeScheduler=1
### REALTIME EXTENSIONS FOR 6.3 ONLY
#SchedulerExecutionTimer=80
#SchedulerSpinTimer=40### DISK DATA
SharedGlobalMemory=20M
DiskPageBufferMemory=64M### Multithreading
MaxNoOfExecutionThreads=2### Increasing the LongMessageBuffer b/c of a bug (20090903)
LongMessageBuffer=8M
BatchSizePerLocalScan=512
[NDBD]
NodeId=3
Hostname=x.x.x.105### REALTIME ASPECTS - THREAD BINDING
### READ http://johanandersson.blogspot.com/2008/02/mysql-cluster-features-what-they-are.html#realtime
#LockExecuteThreadToCPU=X
#LockMaintThreadsToCPU=Y[NDBD]
NodeId=4
Hostname=x.x.x.108### REALTIME ASPECTS - THREAD BINDING
### READ http://johanandersson.blogspot.com/2008/02/mysql-cluster-features-what-they-are.html#realtime
#LockExecuteThreadToCPU=X
#LockMaintThreadsToCPU=Y[MYSQLD DEFAULT]
DefaultOperationRedoProblemAction=QUEUE
BatchSize=512
#BatchByteSize=2048K
#MaxScanBatchSize=2048K[MYSQLD]
NodeId=5
Hostname=x.x.x.105
[MYSQLD]
NodeId=6
Hostname=x.x.x.105
[MYSQLD]
NodeId=7
Hostname=x.x.x.105
[MYSQLD]
NodeId=8
Hostname=x.x.x.x.105[MYSQLD]
NodeId=9
Hostname=x.x.x.108
[MYSQLD]
NodeId=10
Hostname=x.x.x.108
[MYSQLD]
NodeId=11
Hostname=x.x.x.108
[MYSQLD]
NodeId=12
Hostname=x.x.x.108[MYSQLD]
[MYSQLD]
[MYSQLD]
[MYSQLD]
### SLOTS (one for each ndb_mgmd) FOR HELPER APPLICATIONS SUCH AS ndb_show_tables etc
[MYSQLD]
Hostname=x.x.x.103
[MYSQLD]
Hostname=x.x.x.104
### SLOT FOR CMON
[MYSQLD]
Hostname=x.x.x.103 -
./check-ndbd-errlog.sh
select data node to view error log from
id data node
3 x.x.x.105
4 x.x.x.108
Select an id above: 3
cat: /data/mysqlcluster//ndb_3_error.log: No such file or directory
./check-ndbd-errlog.sh
select data node to view error log from
id data node
3 x.x.x.105
4 x.x.x.108
Select an id above: 4
Current byte-offset of file-pointer is: 1067
Time: Friday 10 February 2012 - 10:34:39
Status: Temporary error, restart node
Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing error message, please report a bug)
Error: 2341
Error data: dbacc/DbaccMain.cpp
Error object: DBACC (Line: 1052) 0x00000002
Program: /usr/sbin//ndbmtd
Pid: 3812 thr: 2
Version: mysql-5.1.56 ndb-7.1.18
Trace: /data/mysqlcluster//ndb_4_trace.log.1 /data/mysqlcluster//ndb_4_trace.log.1_t1 /data/mysqlcluster//ndb_4_trace.lo
Time: Friday 10 February 2012 - 13:43:10
Status: Temporary error, restart node
Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing error message, please report a bug)
Error: 2341
Error data: dbacc/DbaccMain.cpp
Error object: DBACC (Line: 1052) 0x00000002
Program: /usr/sbin//ndbmtd
Pid: 3819 thr: 2
Version: mysql-5.1.56 ndb-7.1.18
Trace: /data/mysqlcluster//ndb_4_trace.log.2 /data/mysqlcluster//ndb_4_trace.log.2_t1 /data/mysqlcluster//ndb_4_trace.lo
Please sign in to leave a comment.
Comments
5 comments