On 5/1/2014 12:04 PM, Jan Lindström wrote:

Hi Eric,

Hi Jan,

Can you share the error log from 5.5 when it refused to joint to the cluster, please ?

Please see below the syslog for mysql:

Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: wsrep_load(): Galera 25.3.2-wheezy(rXXXX) by Codership Oy <info@codership.com> loade              d successfully.
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Warning] WSREP: Could not open saved state file for reading: /var/lib/mysql//grastate.dat
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Passing config to GCS: base_host = 10.0.0.65; base_port = 4567; cert.log_conflicts =               no; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_siz              e = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gc              s.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; repl.causal_read_timeout               = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.proto_max = 5
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: wsrep_sst_grab()
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Start replication
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: protonet asio version 0
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Using CRC-32C (optimized) for message checksums.
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: backend: asio
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: GMCast version 0
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: (5940a401-d06d-11e3-94ce-7e204e80941d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.              0.0:4567
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: (5940a401-d06d-11e3-94ce-7e204e80941d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: EVS version 0
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: PC version 0
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: gcomm: bootstrapping new group 'kom_wsrep_cluster'
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Node 5940a401-d06d-11e3-94ce-7e204e80941d state prim
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: view(view_id(PRIM,5940a401-d06d-11e3-94ce-7e204e80941d,1) memb {
Apr 30 15:43:01 db65 mysqld: #0115940a401-d06d-11e3-94ce-7e204e80941d,0
Apr 30 15:43:01 db65 mysqld: } joined {
Apr 30 15:43:01 db65 mysqld: } left {
Apr 30 15:43:01 db65 mysqld: } partitioned {
Apr 30 15:43:01 db65 mysqld: })
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr without UUID: tcp://10.0.0.62:4567
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr proto entry 0x7f9538ce3380
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr without UUID: tcp://10.0.0.63:4567
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr proto entry 0x7f9538ce3440
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr without UUID: tcp://10.0.0.64:4567
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr proto entry 0x7f9538ce3500
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr without UUID: tcp://10.0.0.65:4567
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: discarding pending addr proto entry 0x7f9538ce35c0
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: gcomm: connected
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Opened channel 'kom_wsrep_cluster'
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Waiting for SST to complete.
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Starting new group from scratch: 5942929c-d06d-11e3-8540-372215cc2396
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 5942c362-d06d-11e3-b9bc-bba43078f040
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: STATE EXCHANGE: sent state msg: 5942c362-d06d-11e3-b9bc-bba43078f040
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: STATE EXCHANGE: got state msg: 5942c362-d06d-11e3-b9bc-bba43078f040 from 0 (db65)
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Quorum results:
Apr 30 15:43:01 db65 mysqld: #011version    = 3,
Apr 30 15:43:01 db65 mysqld: #011component = PRIMARY,
Apr 30 15:43:01 db65 mysqld: #011conf_id    = 0,
Apr 30 15:43:01 db65 mysqld: #011members    = 1/1 (joined/total),
Apr 30 15:43:01 db65 mysqld: #011act_id     = 0,
Apr 30 15:43:01 db65 mysqld: #011last_appl. = -1,
Apr 30 15:43:01 db65 mysqld: #011protocols = 0/5/2 (gcs/repl/appl),
Apr 30 15:43:01 db65 mysqld: #011group UUID = 5942929c-d06d-11e3-8540-372215cc2396
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Flow-control interval: [16, 16]
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Restored state OPEN -> JOINED (0)
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Member 0 (db65) synced with group.
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0)
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: New cluster view: global state: 5942929c-d06d-11e3-8540-372215cc2396:0, view# 1: Pri              mary, number of nodes: 1, my index: 0, protocol version 2
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 [Note] WSREP: SST complete, seqno: 0
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 InnoDB: The InnoDB memory heap is disabled
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 InnoDB: Mutexes and rw_locks use GCC atomic builtins
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 InnoDB: Compressed tables use zlib 1.2.7
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 InnoDB: Using Linux native AIO
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 InnoDB: Initializing buffer pool, size = 256.0M
Apr 30 15:43:01 db65 mysqld: 140430 15:43:01 InnoDB: Completed initialization of buffer pool
Apr 30 15:43:02 db65 mysqld: 140430 15:43:02 InnoDB: highest supported file format is Barracuda.
Apr 30 15:43:02 db65 mysqld: 140430 15:43:02 InnoDB: Waiting for the background threads to start
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 Percona XtraDB (http://www.percona.com) 5.5.36-MariaDB-33.0 started; log sequence number 1598139
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] Plugin 'FEEDBACK' is disabled.
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] Server socket created on IP: '0.0.0.0'.
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] Event Scheduler: Loaded 0 events
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] /usr/sbin/mysqld: ready for connections.
Apr 30 15:43:03 db65 mysqld: Version: '5.5.36-MariaDB-1~wheezy-wsrep-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binar              y distribution, wsrep_25.9.r3961
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] WSREP: REPL Protocols: 5 (3, 1)
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] WSREP: Service thread queue flushed.
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] WSREP: Synchronized with group, ready for connections
Apr 30 15:43:03 db65 mysqld: 140430 15:43:03 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 30 15:43:03 db65 /etc/mysql/debian-start[6832]: Upgrading MySQL tables if necessary.
Apr 30 15:43:04 db65 /etc/mysql/debian-start[6836]: /usr/bin/mysql_upgrade: the '--basedir' option is always ignored
Apr 30 15:43:04 db65 /etc/mysql/debian-start[6836]: Looking for 'mysql' as: /usr/bin/mysql
Apr 30 15:43:04 db65 /etc/mysql/debian-start[6836]: Looking for 'mysqlcheck' as: /usr/bin/mysqlcheck
Apr 30 15:43:04 db65 /etc/mysql/debian-start[6836]: This installation of MySQL is already upgraded to 5.5.36-MariaDB, use --force if you still               need to run mysql_upgrade
Apr 30 15:43:04 db65 /etc/mysql/debian-start[6851]: Checking for insecure root accounts.
Apr 30 15:43:04 db65 /etc/mysql/debian-start[6856]: Triggering myisam-recover for all MyISAM tables
Apr 30 15:49:24 db65 mysqld: 140430 15:49:24 [Warning] Access denied for user 'root'@'localhost' (using password: NO)
Apr 30 15:50:27 db65 mysqld: 140430 15:50:27 [Warning] Access denied for user 'root'@'localhost' (using password: NO)
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] /usr/sbin/mysqld: Normal shutdown
Apr 30 15:58:49 db65 mysqld:
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Stop replication
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Closing send monitor...
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Closed send monitor.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: gcomm: terminating thread
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: gcomm: joining thread
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: gcomm: closing backend
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: view((empty))
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Received self-leave message.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: gcomm: closed
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Flow-control interval: [0, 0]
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Received SELF-LEAVE. Closing connection.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 0)
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: RECV thread exiting 0: Success
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: New cluster view: global state: 5942929c-d06d-11e3-8540-372215cc2396:0, view# -1: no              n-Primary, number of nodes: 0, my index: -1, protocol version 2
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: recv_thread() joined.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Closing replication queue.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: Closing slave action queue.
Apr 30 15:58:49 db65 mysqld: 140430 15:58:49 [Note] WSREP: applier thread exiting (code:0)
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: rollbacker thread exiting
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] Event Scheduler: Purging the queue. 0 events
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: dtor state: CLOSED
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: apply mon: entered 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: apply mon: entered 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: mon: entered 3 oooe fraction 0 oool fraction 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: cert index usage at exit 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: cert trx map usage at exit 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: deps set usage at exit 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: avg deps dist 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: 0)
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 [Note] WSREP: Flushing memory map to disk...
Apr 30 15:58:51 db65 mysqld: 140430 15:58:51 InnoDB: Starting shutdown...
Apr 30 15:58:52 db65 mysqld: 140430 15:58:52 InnoDB: Shutdown completed; log sequence number 1598293
Apr 30 15:58:52 db65 mysqld: 140430 15:58:52 [Note] /usr/sbin/mysqld: Shutdown complete
Apr 30 15:58:52 db65 mysqld:
Apr 30 15:58:52 db65 mysqld_safe: mysqld from pid file /var/run/mysqld/mysqld.pid ended
Apr 30 16:03:32 db65 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql
Apr 30 16:03:32 db65 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.34Qk5U' --pid-file='/var/lib              /mysql/db65-recover.pid'
Apr 30 16:03:35 db65 mysqld_safe: WSREP: Recovered position 5942929c-d06d-11e3-8540-372215cc2396:0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: wsrep_start_position var submitted: '5942929c-d06d-11e3-8540-372215cc2396:0'
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Read nil XID from storage engines, skipping position init
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: wsrep_load(): Galera 25.3.2-wheezy(rXXXX) by Codership Oy <info@codership.com> loade              d successfully.
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Found saved state: 5942929c-d06d-11e3-8540-372215cc2396:0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Passing config to GCS: base_host = 10.0.0.65; base_port = 4567; cert.log_conflicts =               no; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_siz              e = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gc              s.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; repl.causal_read_timeout               = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.proto_max = 5
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Assign initial position for certification: 0, protocol version: -1
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: wsrep_sst_grab()
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Start replication
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Setting initial position to 5942929c-d06d-11e3-8540-372215cc2396:0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: protonet asio version 0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: Using CRC-32C (optimized) for message checksums.
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: backend: asio
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: GMCast version 0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') listening at tcp://0.0.              0.0:4567
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: EVS version 0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: PC version 0
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: gcomm: connecting to group 'kom_wsrep_cluster', peer '10.0.0.62:,10.0.0.63:,10.0.0.6              4:,10.0.0.65:'
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Warning] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.              0.65:4567' points to own listening address, blacklisting
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: (386aadec-d070-11e3-801b-a63af238b289, 'tcp://0.0.0.0:4567') address 'tcp://10.0.0.6              5:4567' pointing to uuid 386aadec-d070-11e3-801b-a63af238b289 is blacklisted, skipping
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: declaring 1124381f-d070-11e3-b129-bf8f84b28b14 stable
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: declaring c6d4dcad-d06f-11e3-b556-667aa2e751ca stable
Apr 30 16:03:35 db65 mysqld: 140430 16:03:35 [Note] WSREP: declaring d4e40948-d06f-11e3-a8a9-8ff215511f2f stable
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Node 1124381f-d070-11e3-b129-bf8f84b28b14 state prim
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: view(view_id(PRIM,1124381f-d070-11e3-b129-bf8f84b28b14,5) memb {
Apr 30 16:03:36 db65 mysqld: #0111124381f-d070-11e3-b129-bf8f84b28b14,0
Apr 30 16:03:36 db65 mysqld: #011386aadec-d070-11e3-801b-a63af238b289,0
Apr 30 16:03:36 db65 mysqld: #011c6d4dcad-d06f-11e3-b556-667aa2e751ca,0
Apr 30 16:03:36 db65 mysqld: #011d4e40948-d06f-11e3-a8a9-8ff215511f2f,0
Apr 30 16:03:36 db65 mysqld: } joined {
Apr 30 16:03:36 db65 mysqld: } left {
Apr 30 16:03:36 db65 mysqld: } partitioned {
Apr 30 16:03:36 db65 mysqld: })
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: gcomm: connected
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Opened channel 'kom_wsrep_cluster'
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 4
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: STATE EXCHANGE: sent state msg: 39c599f2-d070-11e3-afbf-3e07438fadfe
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Waiting for SST to complete.
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: STATE EXCHANGE: got state msg: 39c599f2-d070-11e3-afbf-3e07438fadfe from 0 (db64)
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: STATE EXCHANGE: got state msg: 39c599f2-d070-11e3-afbf-3e07438fadfe from 3 (db63)
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: STATE EXCHANGE: got state msg: 39c599f2-d070-11e3-afbf-3e07438fadfe from 2 (db62)
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: STATE EXCHANGE: got state msg: 39c599f2-d070-11e3-afbf-3e07438fadfe from 1 (db65)
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Quorum results:
Apr 30 16:03:36 db65 mysqld: #011version    = 3,
Apr 30 16:03:36 db65 mysqld: #011component = PRIMARY,
Apr 30 16:03:36 db65 mysqld: #011conf_id    = 3,
Apr 30 16:03:36 db65 mysqld: #011members    = 3/4 (joined/total),
Apr 30 16:03:36 db65 mysqld: #011act_id     = 0,
Apr 30 16:03:36 db65 mysqld: #011last_appl. = -1,
Apr 30 16:03:36 db65 mysqld: #011protocols = 0/5/2 (gcs/repl/appl),
Apr 30 16:03:36 db65 mysqld: #011group UUID = 869942f0-d06d-11e3-b7cd-e255df31948c
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Flow-control interval: [32, 32]
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 0)
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: State transfer required:
Apr 30 16:03:36 db65 mysqld: #011Group state: 869942f0-d06d-11e3-b7cd-e255df31948c:0
Apr 30 16:03:36 db65 mysqld: #011Local state: 5942929c-d06d-11e3-8540-372215cc2396:0
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Note] WSREP: New cluster view: global state: 869942f0-d06d-11e3-b7cd-e255df31948c:0, view# 4: Pri              mary, number of nodes: 4, my index: 1, protocol version 2
Apr 30 16:03:36 db65 mysqld: 140430 16:03:36 [Warning] WSREP: Gap in state sequence. Need state transfer.
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '10.0.0.65' --auth '' --datadir               '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '7843''
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Prepared SST request: rsync|10.0.0.65:4444/rsync_sst
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: REPL Protocols: 5 (3, 1)
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Service thread queue flushed.
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (5942929c-d06d              -11e3-8540-372215cc2396) does not match group state UUID (869942f0-d06d-11e3-b7cd-e255df31948c): 1 (Operation not permitted)
Apr 30 16:03:39 db65 mysqld: #011 at galera/src/replicator_str.cpp:prepare_for_IST():445. IST will be unavailable.
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Node 1.0 (db65) requested state transfer from '*any*'. Selected 0.0 (db64)(SYNCED) a              s donor.
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 0)
Apr 30 16:03:39 db65 mysqld: 140430 16:03:39 [Note] WSREP: Requesting state transfer: success, donor: 0
Apr 30 16:03:51 db65 rsyncd[8107]: rsync to rsync_sst/./mysql from UNKNOWN (10.0.0.64)
Apr 30 16:03:52 db65 mysqld: 140430 16:03:52 [Note] WSREP: 0.0 (db64): State transfer to 1.0 (db65) complete.
Apr 30 16:03:52 db65 mysqld: 140430 16:03:52 [Note] WSREP: Member 0 (db64) synced with group.
Apr 30 16:03:52 db65 mysqld: WSREP_SST: [INFO] Joiner cleanup. (20140430 16:03:52.890)
Apr 30 16:03:53 db65 mysqld: WSREP_SST: [INFO] Joiner cleanup done. (20140430 16:03:53.416)
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 [Note] WSREP: SST complete, seqno: 0
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 InnoDB: The InnoDB memory heap is disabled
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 InnoDB: Mutexes and rw_locks use GCC atomic builtins
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 InnoDB: Compressed tables use zlib 1.2.7
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 InnoDB: Using Linux native AIO
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 InnoDB: Initializing buffer pool, size = 256.0M
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 InnoDB: Completed initialization of buffer pool
Apr 30 16:03:53 db65 mysqld: InnoDB: Error: log file ./ib_logfile0 is of different size 0 50331648 bytes
Apr 30 16:03:53 db65 mysqld: InnoDB: than specified in the .cnf file 0 5242880 bytes!
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 [ERROR] Plugin 'InnoDB' init function returned error.
Apr 30 16:03:53 db65 mysqld: 140430 16:03:53 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
Apr 30 16:03:54 db65 mysqld: 140430 16:03:54 [Note] Plugin 'FEEDBACK' is disabled.
Apr 30 16:03:54 db65 mysqld: 140430 16:03:54 [ERROR] Unknown/unsupported storage engine: innodb
Apr 30 16:03:54 db65 mysqld: 140430 16:03:54 [ERROR] Aborting
Apr 30 16:03:54 db65 mysqld:
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Closing send monitor...
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Closed send monitor.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: gcomm: terminating thread
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: gcomm: joining thread
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: gcomm: closing backend
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: view(view_id(NON_PRIM,1124381f-d070-11e3-b129-bf8f84b28b14,5) memb {
Apr 30 16:03:56 db65 mysqld: #011386aadec-d070-11e3-801b-a63af238b289,0
Apr 30 16:03:56 db65 mysqld: } joined {
Apr 30 16:03:56 db65 mysqld: } left {
Apr 30 16:03:56 db65 mysqld: } partitioned {
Apr 30 16:03:56 db65 mysqld: #0111124381f-d070-11e3-b129-bf8f84b28b14,0
Apr 30 16:03:56 db65 mysqld: #011c6d4dcad-d06f-11e3-b556-667aa2e751ca,0
Apr 30 16:03:56 db65 mysqld: #011d4e40948-d06f-11e3-a8a9-8ff215511f2f,0
Apr 30 16:03:56 db65 mysqld: })
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: view((empty))
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: gcomm: closed
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Flow-control interval: [16, 16]
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Received NON-PRIMARY.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Shifting JOINER -> OPEN (TO: 0)
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Received self-leave message.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Flow-control interval: [0, 0]
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Received SELF-LEAVE. Closing connection.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 0)
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: RECV thread exiting 0: Success
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: recv_thread() joined.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Closing replication queue.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Closing slave action queue.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: Service disconnected.
Apr 30 16:03:56 db65 mysqld: 140430 16:03:56 [Note] WSREP: rollbacker thread exiting
Apr 30 16:03:57 db65 mysqld: 140430 16:03:57 [Note] WSREP: Some threads may fail to exit.
Apr 30 16:03:57 db65 mysqld: 140430 16:03:57 [Note] /usr/sbin/mysqld: Shutdown complete
Apr 30 16:03:57 db65 mysqld:
Apr 30 16:04:02 db65 mysqld: Error in my_thread_global_end(): 1 threads didn't exit
Apr 30 16:04:02 db65 mysqld_safe: mysqld from pid file /var/run/mysqld/mysqld.pid ended
Apr 30 16:04:04 db65 /etc/init.d/mysql[8309]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted i              n
Apr 30 16:04:04 db65 /etc/init.d/mysql[8309]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed
Apr 30 16:04:04 db65 /etc/init.d/mysql[8309]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111)'
Apr 30 16:04:04 db65 /etc/init.d/mysql[8309]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
Apr 30 16:04:04 db65 /etc/init.d/mysql[8309]:
Apr 30 16:04:19 db65 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql
Apr 30 16:04:19 db65 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.soIOZM' --pid-file='/var/lib              /mysql/db65-recover.pid'
Apr 30 16:04:20 db65 mysqld_safe: WSREP: Failed to recover position: #012'140430 16:04:19 InnoDB: The InnoDB memory heap is disabled#012140430               16:04:19 InnoDB: Mutexes and rw_locks use GCC atomic builtins#012140430 16:04:19 InnoDB: Compressed tables use zlib 1.2.7#012140430 16:04:19 In              noDB: Using Linux native AIO#012140430 16:04:19 InnoDB: Initializing buffer pool, size = 256.0M#012140430 16:04:20 InnoDB: Completed initializa              tion of buffer pool#012InnoDB: Error: log file ./ib_logfile0 is of different size 0 50331648 bytes#012InnoDB: than specified in the .cnf file 0               5242880 bytes!#012140430 16:04:20 [ERROR] Plugin 'InnoDB' init function returned error.#012140430 16:04:20 [ERROR] Plugin 'InnoDB' registratio              n as a STORAGE ENGINE failed.#012140430 16:04:20 [Note] Plugin 'FEEDBACK' is disabled.#012140430 16:04:20 [ERROR] Unknown/unsupported storage e              ngine: innodb#012140430 16:04:20 [ERROR] Aborting#012#012140430 16:04:20 [Note] /usr/sbin/mysqld: Shutdown complete'
Apr 30 16:04:49 db65 /etc/init.d/mysql[9512]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted i              n
Apr 30 16:04:49 db65 /etc/init.d/mysql[9512]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed
Apr 30 16:04:49 db65 /etc/init.d/mysql[9512]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'
Apr 30 16:04:49 db65 /etc/init.d/mysql[9512]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
Apr 30 16:04:49 db65 /etc/init.d/mysql[9512]:
Apr 30 16:04:56 db65 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql
Apr 30 16:04:56 db65 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.lmU7Ap' --pid-file='/var/lib              /mysql/db65-recover.pid'
Apr 30 16:04:57 db65 mysqld_safe: WSREP: Failed to recover position: #012'140430 16:04:56 InnoDB: The InnoDB memory heap is disabled#012140430               16:04:56 InnoDB: Mutexes and rw_locks use GCC atomic builtins#012140430 16:04:56 InnoDB: Compressed tables use zlib 1.2.7#012140430 16:04:56 In              noDB: Using Linux native AIO#012140430 16:04:56 InnoDB: Initializing buffer pool, size = 256.0M#012140430 16:04:56 InnoDB: Completed initializa              tion of buffer pool#012InnoDB: Error: log file ./ib_logfile0 is of different size 0 50331648 bytes#012InnoDB: than specified in the .cnf file 0               5242880 bytes!#012140430 16:04:57 [ERROR] Plugin 'InnoDB' init function returned error.#012140430 16:04:57 [ERROR] Plugin 'InnoDB' registratio              n as a STORAGE ENGINE failed.#012140430 16:04:57 [Note] Plugin 'FEEDBACK' is disabled.#012140430 16:04:57 [ERROR] Unknown/unsupported storage e              ngine: innodb#012140430 16:04:57 [ERROR] Aborting#012#012140430 16:04:57 [Note] /usr/sbin/mysqld: Shutdown complete'
Apr 30 16:05:26 db65 /etc/init.d/mysql[10715]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted               in
Apr 30 16:05:26 db65 /etc/init.d/mysql[10715]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed
Apr 30 16:05:26 db65 /etc/init.d/mysql[10715]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'
Apr 30 16:05:26 db65 /etc/init.d/mysql[10715]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
Apr 30 16:05:26 db65 /etc/init.d/mysql[10715]:
Apr 30 16:08:37 db65 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql
Apr 30 16:08:37 db65 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.Cju4Ru' --pid-file='/var/lib              /mysql/db65-recover.pid'
Apr 30 16:08:38 db65 mysqld_safe: WSREP: Failed to recover position: #012'140430 16:08:38 InnoDB: The InnoDB memory heap is disabled#012140430               16:08:38 InnoDB: Mutexes and rw_locks use GCC atomic builtins#012140430 16:08:38 InnoDB: Compressed tables use zlib 1.2.7#012140430 16:08:38 In              noDB: Using Linux native AIO#012140430 16:08:38 InnoDB: Initializing buffer pool, size = 256.0M#012140430 16:08:38 InnoDB: Completed initializa              tion of buffer pool#012InnoDB: Error: log file ./ib_logfile0 is of different size 0 50331648 bytes#012InnoDB: than specified in the .cnf file 0               5242880 bytes!#012140430 16:08:38 [ERROR] Plugin 'InnoDB' init function returned error.#012140430 16:08:38 [ERROR] Plugin 'InnoDB' registratio              n as a STORAGE ENGINE failed.#012140430 16:08:38 [Note] Plugin 'FEEDBACK' is disabled.#012140430 16:08:38 [ERROR] Unknown/unsupported storage e              ngine: innodb#012140430 16:08:38 [ERROR] Aborting#012#012140430 16:08:38 [Note] /usr/sbin/mysqld: Shutdown complete'
Apr 30 16:09:07 db65 /etc/init.d/mysql[11918]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted               in

R: Jan
On 5/1/2014 11:01 AM, Jan Lindström wrote:

Hi,

It depends on exact version you had on 5.5, can you share us the exact version and error messages you got ?
mariadb-5.5.35 should be compatible with 10.0, but earlier 5.5 versions are not because they use older Galera
cluster provider version 23.2.x when newer one you can use 25.2.x or 25.3.x,

mariadb-galera-server-5.5 (5.5.37+maria-1~wheezy)
R: Jan

Hi All,
I'm new in the clustering, after installed 4 nodes with 3 having version 10.0 and another with version 5.5, this last did not want to join the cluster until I upgrade it to version 10.0.
My question is, they is an incompatibility between the two versions?
Thanks

_______________________________________________
Mailing list: https://launchpad.net/~maria-discuss
Post to     : maria-discuss@lists.launchpad.net
Unsubscribe : https://launchpad.net/~maria-discuss
More help   : https://help.launchpad.net/ListHelp

--

--

Jan Lindström, Principal Engineer
SkySQL - The MariaDB Company

MariaDB | MaxScale | skype: jan_p_lindstrom

www.skysql.com
_______________________________________________
Mailing list: https://launchpad.net/~maria-discuss
Post to     : maria-discuss@lists.launchpad.net
Unsubscribe : https://launchpad.net/~maria-discuss
More help   : https://help.launchpad.net/ListHelp
--

--

Jan Lindström, Principal Engineer
SkySQL - The MariaDB Company

MariaDB | MaxScale | skype: jan_p_lindstrom

www.skysql.com