Description:
After a couple of days running the cluster, today I restarted 1 mysqld node.
when back online, it was unable to access all the tables of the db with these
warnings:
mysql> show warnings;
+-------+------+--------------------------------------------------------------------------------------------------------------+
| Level | Code |
Message |
+-------+------+--------------------------------------------------------------------------------------------------------------+
| Error | 1296 | Got error 4243 'Index not found' from
NDB |
| Error | 1296 | Got error 284 'Table not defined in transaction coordinator'
from Could not log query '%s' on other mysqld's |
| Error | 1296 | Got error 4243 'Index not found' from
NDB |
| Error | 1296 | Got error 4243 'Index not found' from
NDB |
| Error | 1296 | Got error 284 'Table not defined in transaction coordinator'
from Could not log query '%s' on other mysqld's |
| Error | 1296 | Got error 4243 'Index not found' from
NDB |
| Error | 1296 | Got error 4243 'Index not found' from
NDB |
| Error | 1296 | Got error 284 'Table not defined in transaction coordinator'
from Could not log query '%s' on other mysqld's |
| Error | 1296 | Got error 4243 'Index not found' from
NDB |
+-------+------+--------------------------------------------------------------------------------------------------------------+
After that, I decided to stop the API node, remove the DB from disk
(/var/lib/mysql/db_name) and restart the API node.
After that, i recreated the db, in order to populate it from ndb, but these
errors appeared:
mysql> show warnings;
+---------+------+----------------------------------------------------+
| Level | Code | Message |
+---------+------+----------------------------------------------------+
| Warning | 1050 | Local table openser.aliases shadows ndb table |
| Warning | 1050 | Local table openser.dispatcher shadows ndb table |
| Warning | 1050 | Local table openser.gw_grp shadows ndb table |
| Warning | 1050 | Local table openser.imc_members shadows ndb table |
| Warning | 1050 | Local table openser.lcr shadows ndb table |
| Warning | 1050 | Local table openser.location shadows ndb table |
| Warning | 1050 | Local table openser.missed_calls shadows ndb table |
| Warning | 1050 | Local table openser.re_grp shadows ndb table |
| Warning | 1050 | Local table openser.trusted shadows ndb table |
+---------+------+----------------------------------------------------+
Finally, as last resort, I shutted down the cluster with SHUTDOWN from
mgm, then restarted back.
But when trying to restart the data nodes, I get these different errors:
Node 2: Forced node shutdown completed. Occured during startphase 4. Caused by
error 2306: 'Pointer too large(Internal error, programming error or missing
error message, please report a bug). Temporary error, restart node
Node 3: Forced node shutdown completed. Occured during startphase 4. Caused by
error 2341: 'Internal program error (failed ndbrequire)(Internal error,
programming error or missing error message, please report a bug). Temporary
error, restart node
How to repeat:
still trying to repeat with same environment.
