[Maria-discuss] MariaDB Cluster wont start
I have a 3node galera-mariadb10 cluster working without issues until today in ubuntu 14.04, all node stop, all i can grasp from mysqld is this: [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 [Note] WSREP: Read nil XID from storage engines, skipping position init [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy < info@codership.com> loaded successfully. [Note] WSREP: CRC-32C: using hardware acceleration. [Note] WSREP: Found saved state: 193c65da-169f-11e4-a58c-ba3055701076:-1 [Note] WSREP: Passing config to GCS: base_host = 172.17.1.2; base_port = 4567; cert.log_conflicts = no; debug = no; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 1; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = P30S; pc.weight = 1; protonet. Note] WSREP: Service thread queue flushed. [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 [Note] WSREP: wsrep_sst_grab() [Note] WSREP: Start replication [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 [Note] WSREP: protonet asio version 0 [Note] WSREP: Using CRC-32C (optimized) for message checksums. [Note] WSREP: backend: asio [Note] WSREP: GMCast version 0 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 140929 13:05:34 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp:// 0.0.0.0:4567') multicast: , ttl: 1 [Note] WSREP: EVS version 0 [Note] WSREP: PC version 0 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' [Warning] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') address 'tcp://172.17.1.2:4567' points to own listening address, blacklisting [Warning] WSREP: no nodes coming from prim view, prim not possible [Note] WSREP: view(view_id(NON_PRIM,d35fbdc5-47fa-11e4-88ce-ebeacde19e39,1) memb { d35fbdc5-47fa-11e4-88ce-ebeacde19e39,0 } joined { } left { } partitioned { }) [Note] WSREP: gcomm: connected 7 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) [Note] WSREP: Opened channel 'baruwa_cluster' [Note] WSREP: Waiting for SST to complete. [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 [Note] WSREP: Received NON-PRIMARY. [Note] WSREP: New cluster view: global state: :-1, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5018S), skipping check my.cnf: #galera settings wsrep_provider=/usr/lib/galera/libgalera_smm.so wsrep_cluster_address="gcomm://baruwadb1,baruwadb2,baruwadb3?pc.wait_prim=no" wsrep_sst_method=rsync wsrep_cluster_name="baruwa_cluster" Any help will be appreciated. Thanks and regards
Hi, On Mon, Sep 29, 2014 at 1:11 PM, Carlos Raúl Laguna <carlosla1987@gmail.com> wrote:
I have a 3node galera-mariadb10 cluster working without issues until today in ubuntu 14.04, all node stop, all i can grasp from mysqld is this:
The provided log seem to be incomplete? I do not see any error that would have caused the node to stop or abort.
[Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 [Note] WSREP: Read nil XID from storage engines, skipping position init [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy < info@codership.com> loaded successfully. [Note] WSREP: CRC-32C: using hardware acceleration. [Note] WSREP: Found saved state: 193c65da-169f-11e4-a58c-ba3055701076:-1 [Note] WSREP: Passing config to GCS: base_host = 172.17.1.2; base_port = 4567; cert.log_conflicts = no; debug = no; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 1; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = P30S; pc.weight = 1; protonet. Note] WSREP: Service thread queue flushed. [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 [Note] WSREP: wsrep_sst_grab() [Note] WSREP: Start replication [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 [Note] WSREP: protonet asio version 0 [Note] WSREP: Using CRC-32C (optimized) for message checksums. [Note] WSREP: backend: asio [Note] WSREP: GMCast version 0 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 140929 13:05:34 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 [Note] WSREP: EVS version 0 [Note] WSREP: PC version 0 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' [Warning] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp:// 0.0.0.0:4567') address 'tcp://172.17.1.2:4567' points to own listening address, blacklisting [Warning] WSREP: no nodes coming from prim view, prim not possible [Note] WSREP: view(view_id(NON_PRIM,d35fbdc5-47fa-11e4-88ce-ebeacde19e39,1) memb { d35fbdc5-47fa-11e4-88ce-ebeacde19e39,0 } joined { } left { } partitioned { }) [Note] WSREP: gcomm: connected 7 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) [Note] WSREP: Opened channel 'baruwa_cluster' [Note] WSREP: Waiting for SST to complete. [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 [Note] WSREP: Received NON-PRIMARY. [Note] WSREP: New cluster view: global state: :-1, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5018S), skipping check
my.cnf: #galera settings wsrep_provider=/usr/lib/galera/libgalera_smm.so
wsrep_cluster_address="gcomm://baruwadb1,baruwadb2,baruwadb3?pc.wait_prim=no" wsrep_sst_method=rsync wsrep_cluster_name="baruwa_cluster"
Perhaps you need to bootstrap the cluster. Best, Nirbhay
Any help will be appreciated. Thanks and regards
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
The log is actually just the output of executing mysqld i just focus in this part, address 'tcp://172.17.1.2:4567' points to own listening address, blacklisting, However i do manage to start one node, now the problem it seems to be in the other to, here is what it show when y try to add the second node to the cluster. 140929 16:24:41 [Note] WSREP: Service thread queue flushed. 140929 16:24:41 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 140929 16:24:41 [Note] WSREP: wsrep_sst_grab() 140929 16:24:41 [Note] WSREP: Start replication 140929 16:24:41 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000- 000000000000:-1 140929 16:24:41 [Note] WSREP: protonet asio version 0 140929 16:24:41 [Note] WSREP: Using CRC-32C (optimized) for message checksums. 140929 16:24:41 [Note] WSREP: backend: asio 140929 16:24:41 [Note] WSREP: GMCast version 0 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp:// 0.0.0.0:4567') listening at tcp://0.0.0.0:4567 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp:// 0.0.0.0:4567') multicast: , ttl: 1 140929 16:24:41 [Note] WSREP: EVS version 0 140929 16:24:41 [Note] WSREP: PC version 0 140929 16:24:41 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:' 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp:// 0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp:// 172.17.1.4:4567 140929 16:24:41 [Note] WSREP: declaring 498ac792-480e-11e4-994f-533085d0ff8b stable 140929 16:24:41 [Note] WSREP: declaring ef83de45-4807-11e4-8802-0203dc2e072c stable 140929 16:24:41 [Note] WSREP: Node 498ac792-480e-11e4-994f-533085d0ff8b state prim 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp:// 0.0.0.0:4567') turning message relay requesting off 140929 16:24:41 [Note] WSREP: view(view_id(PRIM,498ac792-480e-11e4-994f-533085d0ff8b,3) memb { 498ac792-480e-11e4-994f-533085d0ff8b,0 a47be000-4816-11e4-b0fd-43eda06d6eff,0 ef83de45-4807-11e4-8802-0203dc2e072c,0 } joined { } left { } partitioned { }) 140929 16:24:41 [Note] WSREP: gcomm: connected 140929 16:24:41 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 140929 16:24:41 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 140929 16:24:41 [Note] WSREP: Opened channel 'baruwa_cluster' 140929 16:24:41 [Note] WSREP: Waiting for SST to complete. 140929 16:24:41 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: sent state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: got state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 from 0 (baruwadb2) 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: got state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 from 2 (baruwadb1) 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: got state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 from 1 (baruwadb3) 140929 16:24:41 [Note] WSREP: Quorum results: version = 3, component = PRIMARY, conf_id = 2, members = 2/3 (joined/total), act_id = 1, last_appl. = -1, protocols = 0/5/3 (gcs/repl/appl), group UUID = 0c63fe44-47fe-11e4-8d91-d3636a34c2fc 140929 16:24:41 [Note] WSREP: Flow-control interval: [28, 28] 140929 16:24:41 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1) 140929 16:24:41 [Note] WSREP: State transfer required: Group state: 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1 Local state: 00000000-0000-0000-0000-000000000000:-1 140929 16:24:41 [Note] WSREP: New cluster view: global state: 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1, view# 3: Primary, number of nodes: 3, my index: 1, protocol version 3 140929 16:24:41 [Warning] WSREP: Gap in state sequence. Need state transfer. 140929 16:24:43 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '172.17.1.12' --auth '' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '22299' '' ' 140929 16:24:44 [Note] WSREP: Prepared SST request: rsync| 172.17.1.12:4444/rsync_sst 140929 16:24:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 140929 16:24:44 [Note] WSREP: REPL Protocols: 5 (3, 1) 140929 16:24:44 [Note] WSREP: Service thread queue flushed. 140929 16:24:44 [Note] WSREP: Assign initial position for certification: 1, protocol version: 3 140929 16:24:44 [Note] WSREP: Service thread queue flushed. 140929 16:24:44 [Warning]* WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (0c63fe44-47fe-11e4-8d91-d3636a34c2fc): 1 (Operation not permitted)* at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable. 140929 16:24:44 [Note] WSREP: Member 1.0 (baruwadb3) requested state transfer from '*any*'. Selected 0.0 (baruwadb2)(SYNCED) as donor. 140929 16:24:44 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1) 140929 16:24:44 [Note] WSREP: Requesting state transfer: success, donor: 0 Any ideas ? 2014-09-29 15:55 GMT-04:00 Nirbhay Choubey <nirbhay@mariadb.com>:
Hi,
On Mon, Sep 29, 2014 at 1:11 PM, Carlos Raúl Laguna < carlosla1987@gmail.com> wrote:
I have a 3node galera-mariadb10 cluster working without issues until today in ubuntu 14.04, all node stop, all i can grasp from mysqld is this:
The provided log seem to be incomplete? I do not see any error that would have caused the node to stop or abort.
[Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 [Note] WSREP: Read nil XID from storage engines, skipping position init [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy < info@codership.com> loaded successfully. [Note] WSREP: CRC-32C: using hardware acceleration. [Note] WSREP: Found saved state: 193c65da-169f-11e4-a58c-ba3055701076:-1 [Note] WSREP: Passing config to GCS: base_host = 172.17.1.2; base_port = 4567; cert.log_conflicts = no; debug = no; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 1; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = P30S; pc.weight = 1; protonet. Note] WSREP: Service thread queue flushed. [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 [Note] WSREP: wsrep_sst_grab() [Note] WSREP: Start replication [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 [Note] WSREP: protonet asio version 0 [Note] WSREP: Using CRC-32C (optimized) for message checksums. [Note] WSREP: backend: asio [Note] WSREP: GMCast version 0 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 140929 13:05:34 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 [Note] WSREP: EVS version 0 [Note] WSREP: PC version 0 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' [Warning] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp:// 0.0.0.0:4567') address 'tcp://172.17.1.2:4567' points to own listening address, blacklisting [Warning] WSREP: no nodes coming from prim view, prim not possible [Note] WSREP: view(view_id(NON_PRIM,d35fbdc5-47fa-11e4-88ce-ebeacde19e39,1) memb { d35fbdc5-47fa-11e4-88ce-ebeacde19e39,0 } joined { } left { } partitioned { }) [Note] WSREP: gcomm: connected 7 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) [Note] WSREP: Opened channel 'baruwa_cluster' [Note] WSREP: Waiting for SST to complete. [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 [Note] WSREP: Received NON-PRIMARY. [Note] WSREP: New cluster view: global state: :-1, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5018S), skipping check
my.cnf: #galera settings wsrep_provider=/usr/lib/galera/libgalera_smm.so
wsrep_cluster_address="gcomm://baruwadb1,baruwadb2,baruwadb3?pc.wait_prim=no" wsrep_sst_method=rsync wsrep_cluster_name="baruwa_cluster"
Perhaps you need to bootstrap the cluster.
Best, Nirbhay
Any help will be appreciated. Thanks and regards
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
Hi! On Mon, Sep 29, 2014 at 4:40 PM, Carlos Raúl Laguna <carlosla1987@gmail.com> wrote:
The log is actually just the output of executing mysqld i just focus in this part,
address 'tcp://172.17.1.2:4567' points to own listening address, blacklisting,
However i do manage to start one node, now the problem it seems to be in the other to, here is what it show when y try to add the second node to the cluster.
140929 16:24:41 [Note] WSREP: Service thread queue flushed. 140929 16:24:41 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 140929 16:24:41 [Note] WSREP: wsrep_sst_grab() 140929 16:24:41 [Note] WSREP: Start replication 140929 16:24:41 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000- 000000000000:-1 140929 16:24:41 [Note] WSREP: protonet asio version 0 140929 16:24:41 [Note] WSREP: Using CRC-32C (optimized) for message checksums. 140929 16:24:41 [Note] WSREP: backend: asio 140929 16:24:41 [Note] WSREP: GMCast version 0 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 140929 16:24:41 [Note] WSREP: EVS version 0 140929 16:24:41 [Note] WSREP: PC version 0 140929 16:24:41 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:' 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://172.17.1.4:4567 140929 16:24:41 [Note] WSREP: declaring 498ac792-480e-11e4-994f-533085d0ff8b stable 140929 16:24:41 [Note] WSREP: declaring ef83de45-4807-11e4-8802-0203dc2e072c stable 140929 16:24:41 [Note] WSREP: Node 498ac792-480e-11e4-994f-533085d0ff8b state prim 140929 16:24:41 [Note] WSREP: (a47be000-4816-11e4-b0fd-43eda06d6eff, 'tcp://0.0.0.0:4567') turning message relay requesting off 140929 16:24:41 [Note] WSREP: view(view_id(PRIM,498ac792-480e-11e4-994f-533085d0ff8b,3) memb { 498ac792-480e-11e4-994f-533085d0ff8b,0 a47be000-4816-11e4-b0fd-43eda06d6eff,0 ef83de45-4807-11e4-8802-0203dc2e072c,0 } joined { } left { } partitioned { }) 140929 16:24:41 [Note] WSREP: gcomm: connected 140929 16:24:41 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 140929 16:24:41 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 140929 16:24:41 [Note] WSREP: Opened channel 'baruwa_cluster' 140929 16:24:41 [Note] WSREP: Waiting for SST to complete. 140929 16:24:41 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: sent state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: got state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 from 0 (baruwadb2) 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: got state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 from 2 (baruwadb1) 140929 16:24:41 [Note] WSREP: STATE EXCHANGE: got state msg: a49fe848-4816-11e4-a8c7-b70f254d3249 from 1 (baruwadb3) 140929 16:24:41 [Note] WSREP: Quorum results: version = 3, component = PRIMARY, conf_id = 2, members = 2/3 (joined/total), act_id = 1, last_appl. = -1, protocols = 0/5/3 (gcs/repl/appl), group UUID = 0c63fe44-47fe-11e4-8d91-d3636a34c2fc 140929 16:24:41 [Note] WSREP: Flow-control interval: [28, 28] 140929 16:24:41 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1) 140929 16:24:41 [Note] WSREP: State transfer required: Group state: 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1 Local state: 00000000-0000-0000-0000-000000000000:-1 140929 16:24:41 [Note] WSREP: New cluster view: global state: 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1, view# 3: Primary, number of nodes: 3, my index: 1, protocol version 3 140929 16:24:41 [Warning] WSREP: Gap in state sequence. Need state transfer. 140929 16:24:43 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '172.17.1.12' --auth '' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '22299' '' ' 140929 16:24:44 [Note] WSREP: Prepared SST request: rsync| 172.17.1.12:4444/rsync_sst 140929 16:24:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 140929 16:24:44 [Note] WSREP: REPL Protocols: 5 (3, 1) 140929 16:24:44 [Note] WSREP: Service thread queue flushed. 140929 16:24:44 [Note] WSREP: Assign initial position for certification: 1, protocol version: 3 140929 16:24:44 [Note] WSREP: Service thread queue flushed. 140929 16:24:44 [Warning]* WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (0c63fe44-47fe-11e4-8d91-d3636a34c2fc): 1 (Operation not permitted)* at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable. 140929 16:24:44 [Note] WSREP: Member 1.0 (baruwadb3) requested state transfer from '*any*'. Selected 0.0 (baruwadb2)(SYNCED) as donor. 140929 16:24:44 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1) 140929 16:24:44 [Note] WSREP: Requesting state transfer: success, donor: 0
There should be more after this. Besides, you should also inspect donor logs for any issues or errors. Best, Nirbhay Any ideas ?
2014-09-29 15:55 GMT-04:00 Nirbhay Choubey <nirbhay@mariadb.com>:
Hi,
On Mon, Sep 29, 2014 at 1:11 PM, Carlos Raúl Laguna < carlosla1987@gmail.com> wrote:
I have a 3node galera-mariadb10 cluster working without issues until today in ubuntu 14.04, all node stop, all i can grasp from mysqld is this:
The provided log seem to be incomplete? I do not see any error that would have caused the node to stop or abort.
[Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 [Note] WSREP: Read nil XID from storage engines, skipping position init [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy <info@codership.com> loaded successfully. [Note] WSREP: CRC-32C: using hardware acceleration. [Note] WSREP: Found saved state: 193c65da-169f-11e4-a58c-ba3055701076:-1 [Note] WSREP: Passing config to GCS: base_host = 172.17.1.2; base_port = 4567; cert.log_conflicts = no; debug = no; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 1; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = P30S; pc.weight = 1; protonet. Note] WSREP: Service thread queue flushed. [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 [Note] WSREP: wsrep_sst_grab() [Note] WSREP: Start replication [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 [Note] WSREP: protonet asio version 0 [Note] WSREP: Using CRC-32C (optimized) for message checksums. [Note] WSREP: backend: asio [Note] WSREP: GMCast version 0 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp:// 0.0.0.0:4567') listening at tcp://0.0.0.0:4567 140929 13:05:34 [Note] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 [Note] WSREP: EVS version 0 [Note] WSREP: PC version 0 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' [Warning] WSREP: (d35fbdc5-47fa-11e4-88ce-ebeacde19e39, 'tcp:// 0.0.0.0:4567') address 'tcp://172.17.1.2:4567' points to own listening address, blacklisting [Warning] WSREP: no nodes coming from prim view, prim not possible [Note] WSREP: view(view_id(NON_PRIM,d35fbdc5-47fa-11e4-88ce-ebeacde19e39,1) memb { d35fbdc5-47fa-11e4-88ce-ebeacde19e39,0 } joined { } left { } partitioned { }) [Note] WSREP: gcomm: connected 7 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) [Note] WSREP: Opened channel 'baruwa_cluster' [Note] WSREP: Waiting for SST to complete. [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 [Note] WSREP: Received NON-PRIMARY. [Note] WSREP: New cluster view: global state: :-1, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.5018S), skipping check
my.cnf: #galera settings wsrep_provider=/usr/lib/galera/libgalera_smm.so
wsrep_cluster_address="gcomm://baruwadb1,baruwadb2,baruwadb3?pc.wait_prim=no" wsrep_sst_method=rsync wsrep_cluster_name="baruwa_cluster"
Perhaps you need to bootstrap the cluster.
Best, Nirbhay
Any help will be appreciated. Thanks and regards
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
You were right This is the complete logs when i tray to start mariadb in the second node. Sep 29 17:03:32 baruwAdb3 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql Sep 29 17:03:32 baruwAdb3 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.eRh9HO' --pid-file='/var/lib/mysql/baruwAdb3-recover.pid' Sep 29 17:03:32 baruwAdb3 mysqld: 140929 17:03:32 [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 Sep 29 17:03:36 baruwAdb3 mysqld_safe: WSREP: Recovered position 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_start_position var submitted: '0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Read nil XID from storage engines, skipping position init Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy <info@codership.comSep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: protonet asio version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Using CRC-32C (optimized) for message checksums. Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: backend: asio Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: GMCast version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: EVS version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: PC version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Warning] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') address 'tcp:// 172.17.1.12:4567' points to own listening address, blacklisting Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') address 'tcp:// 172.17.1.12:4567' pointing to uuid 1475a37f-481c-11e4-b9cc-ee8fe601500f is blacklisted, skipping Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: declaring 55a2a1b4-481a-11e4-912d-93d52c4f97cc stable Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Node 55a2a1b4-481a-11e4-912d-93d52c4f97cc state prim Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: view(view_id(PRIM,1475a37f-481c-11e4-b9cc-ee8fe601500f,2) memb { Sep 29 17:03:37 baruwAdb3 mysqld: #0111475a37f-481c-11e4-b9cc-ee8fe601500f,0 Sep 29 17:03:37 baruwAdb3 mysqld: #01155a2a1b4-481a-11e4-912d-93d52c4f97cc,0 Sep 29 17:03:37 baruwAdb3 mysqld: } joined { Sep 29 17:03:37 baruwAdb3 mysqld: } left { Sep 29 17:03:37 baruwAdb3 mysqld: } partitioned { Sep 29 17:03:37 baruwAdb3 mysqld: }) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: discarding pending addr without UUID: tcp://172.17.1.4:4567 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: discarding pending addr proto entry 0x7f4043ae18c0 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: gcomm: connected Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Opened channel 'baruwa_cluster' Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Waiting for SST to complete. Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 14c24d3f-481c-11e4-a0af-cae2115c6e2e Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: sent state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: got state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e from 0 (baruwadb3) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: got state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e from 1 (baruwadb1) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Quorum results: Sep 29 17:03:37 baruwAdb3 mysqld: #011version = 3, Sep 29 17:03:37 baruwAdb3 mysqld: #011component = PRIMARY, Sep 29 17:03:37 baruwAdb3 mysqld: #011conf_id = 1, Sep 29 17:03:37 baruwAdb3 mysqld: #011members = 1/2 (joined/total), Sep 29 17:03:37 baruwAdb3 mysqld: #011act_id = 1, Sep 29 17:03:37 baruwAdb3 mysqld: #011last_appl. = -1, Sep 29 17:03:37 baruwAdb3 mysqld: #011protocols = 0/5/3 (gcs/repl/appl), Sep 29 17:03:37 baruwAdb3 mysqld: #011group UUID = 0c63fe44-47fe-11e4-8d91-d3636a34c2fc Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Flow-control interval: [23, 23] Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Warning] WSREP: Gap in state sequence. Need state transfer. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '172.17.1.12' --auth '' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '26706' '' ' Sep 29 17:03:39 baruwAdb3 rsyncd[26804]: rsyncd version 3.1.0 starting, listening on port 4444 Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Prepared SST request: rsync|172.17.1.12:4444/rsync_sst Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: REPL Protocols: 5 (3, 1) Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Service thread queue flushed. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Assign initial position for certification: 1, protocol version: 3 Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Service thread queue flushed. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (0c63fe44-47fe-11e4-8d91-d3636a34c2fc): 1 (Operation not permitted) Sep 29 17:03:39 baruwAdb3 mysqld: #011 at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Member 0.0 (baruwadb3) requested state transfer from '*any*'. Selected 1.0 (baruwadb1)(SYNCED) as donor. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1) Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Requesting state transfer: success, donor: 1 Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: rsync to rsync_sst/ from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: receiving file list Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:43 baruwAdb3 rsyncd[26819]: sent 44 bytes received 209,766,748 bytes total size 209,715,200 Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: rsync to rsync_sst-log_dir/ from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: receiving file list Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted in Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111 "Connection refused")' Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists! Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[26929]: sent 63 bytes received 1,074,004,182 bytes total size 1,073,741,824 Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: rsync to rsync_sst/./performance_schema from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: rsync to rsync_sst/./sa_bayes from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: receiving file list Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: receiving file list Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:15 baruwAdb3 rsyncd[27730]: sent 1,036 bytes received 100,517 bytes total size 96,357 Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: rsync to rsync_sst/./mysql from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: receiving file list Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:16 baruwAdb3 rsyncd[27758]: sent 1,682 bytes received 1,139,500 bytes total size 1,133,625 Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: rsync to rsync_sst/./baruwa from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: receiving file list Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:18 baruwAdb3 rsyncd[27731]: sent 238 bytes received 93,682,655 bytes total size 93,659,026 Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: rsync to rsync_sst/./test from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: receiving file list Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: sent 48 bytes received 205 bytes total size 61 Thanks for your time. Regards
Hello, On Mon, Sep 29, 2014 at 5:10 PM, Carlos Raúl Laguna <carlosla1987@gmail.com> wrote:
You were right
This is the complete logs when i tray to start mariadb in the second node.
I do not see anything unusual in the logs. -- Nirbhay
Sep 29 17:03:32 baruwAdb3 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql Sep 29 17:03:32 baruwAdb3 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.eRh9HO' --pid-file='/var/lib/mysql/baruwAdb3-recover.pid' Sep 29 17:03:32 baruwAdb3 mysqld: 140929 17:03:32 [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 Sep 29 17:03:36 baruwAdb3 mysqld_safe: WSREP: Recovered position 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_start_position var submitted: '0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Read nil XID from storage engines, skipping position init Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy <info@codership.comSep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: protonet asio version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Using CRC-32C (optimized) for message checksums. Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: backend: asio Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: GMCast version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: EVS version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: PC version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Warning] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') address 'tcp://172.17.1.12:4567' points to own listening address, blacklisting Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') address 'tcp://172.17.1.12:4567' pointing to uuid 1475a37f-481c-11e4-b9cc-ee8fe601500f is blacklisted, skipping Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: declaring 55a2a1b4-481a-11e4-912d-93d52c4f97cc stable Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Node 55a2a1b4-481a-11e4-912d-93d52c4f97cc state prim Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: view(view_id(PRIM,1475a37f-481c-11e4-b9cc-ee8fe601500f,2) memb { Sep 29 17:03:37 baruwAdb3 mysqld: #0111475a37f-481c-11e4-b9cc-ee8fe601500f,0 Sep 29 17:03:37 baruwAdb3 mysqld: #01155a2a1b4-481a-11e4-912d-93d52c4f97cc,0 Sep 29 17:03:37 baruwAdb3 mysqld: } joined { Sep 29 17:03:37 baruwAdb3 mysqld: } left { Sep 29 17:03:37 baruwAdb3 mysqld: } partitioned { Sep 29 17:03:37 baruwAdb3 mysqld: }) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: discarding pending addr without UUID: tcp://172.17.1.4:4567 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: discarding pending addr proto entry 0x7f4043ae18c0 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: gcomm: connected Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Opened channel 'baruwa_cluster' Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Waiting for SST to complete. Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 14c24d3f-481c-11e4-a0af-cae2115c6e2e Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: sent state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: got state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e from 0 (baruwadb3) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: got state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e from 1 (baruwadb1) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Quorum results: Sep 29 17:03:37 baruwAdb3 mysqld: #011version = 3, Sep 29 17:03:37 baruwAdb3 mysqld: #011component = PRIMARY, Sep 29 17:03:37 baruwAdb3 mysqld: #011conf_id = 1, Sep 29 17:03:37 baruwAdb3 mysqld: #011members = 1/2 (joined/total), Sep 29 17:03:37 baruwAdb3 mysqld: #011act_id = 1, Sep 29 17:03:37 baruwAdb3 mysqld: #011last_appl. = -1, Sep 29 17:03:37 baruwAdb3 mysqld: #011protocols = 0/5/3 (gcs/repl/appl), Sep 29 17:03:37 baruwAdb3 mysqld: #011group UUID = 0c63fe44-47fe-11e4-8d91-d3636a34c2fc Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Flow-control interval: [23, 23] Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Warning] WSREP: Gap in state sequence. Need state transfer. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '172.17.1.12' --auth '' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '26706' '' ' Sep 29 17:03:39 baruwAdb3 rsyncd[26804]: rsyncd version 3.1.0 starting, listening on port 4444 Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Prepared SST request: rsync|172.17.1.12:4444/rsync_sst Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: REPL Protocols: 5 (3, 1) Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Service thread queue flushed. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Assign initial position for certification: 1, protocol version: 3 Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Service thread queue flushed. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (0c63fe44-47fe-11e4-8d91-d3636a34c2fc): 1 (Operation not permitted) Sep 29 17:03:39 baruwAdb3 mysqld: #011 at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Member 0.0 (baruwadb3) requested state transfer from '*any*'. Selected 1.0 (baruwadb1)(SYNCED) as donor. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1) Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Requesting state transfer: success, donor: 1 Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: rsync to rsync_sst/ from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: receiving file list Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:43 baruwAdb3 rsyncd[26819]: sent 44 bytes received 209,766,748 bytes total size 209,715,200 Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: rsync to rsync_sst-log_dir/ from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: receiving file list Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted in Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111 "Connection refused")' Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists! Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[26929]: sent 63 bytes received 1,074,004,182 bytes total size 1,073,741,824 Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: rsync to rsync_sst/./performance_schema from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: rsync to rsync_sst/./sa_bayes from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: receiving file list Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: receiving file list Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:15 baruwAdb3 rsyncd[27730]: sent 1,036 bytes received 100,517 bytes total size 96,357 Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: rsync to rsync_sst/./mysql from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: receiving file list Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:16 baruwAdb3 rsyncd[27758]: sent 1,682 bytes received 1,139,500 bytes total size 1,133,625 Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: rsync to rsync_sst/./baruwa from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: receiving file list Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:18 baruwAdb3 rsyncd[27731]: sent 238 bytes received 93,682,655 bytes total size 93,659,026 Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: rsync to rsync_sst/./test from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: receiving file list Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: sent 48 bytes received 205 bytes total size 61
Thanks for your time. Regards
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
SOLVED, for some unknown reason my.cnf in all nodes was 644 checking the logs i see that mariadb update to 10.0.14 but not sure how is related to this, if it is at all. I think this was a layer 8 problem must check auth.log to be sure. Thanks for your time and help. If you ever visit cuba let me buy you a beer. Regards. 2014-09-29 17:56 GMT-04:00 Nirbhay Choubey <nirbhay@mariadb.com>:
Hello,
On Mon, Sep 29, 2014 at 5:10 PM, Carlos Raúl Laguna < carlosla1987@gmail.com> wrote:
You were right
This is the complete logs when i tray to start mariadb in the second node.
I do not see anything unusual in the logs.
-- Nirbhay
Sep 29 17:03:32 baruwAdb3 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql Sep 29 17:03:32 baruwAdb3 mysqld_safe: WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.eRh9HO' --pid-file='/var/lib/mysql/baruwAdb3-recover.pid' Sep 29 17:03:32 baruwAdb3 mysqld: 140929 17:03:32 [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 Sep 29 17:03:36 baruwAdb3 mysqld_safe: WSREP: Recovered position 0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Warning] option 'table_cache': unsigned value 2097152 adjusted to 524288 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_start_position var submitted: '0c63fe44-47fe-11e4-8d91-d3636a34c2fc:1' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Read nil XID from storage engines, skipping position init Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: wsrep_load(): Galera 25.3.5-wheezy(rXXXX) by Codership Oy <info@codership.comSep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: protonet asio version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: Using CRC-32C (optimized) for message checksums. Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: backend: asio Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: GMCast version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: EVS version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: PC version 0 Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: gcomm: connecting to group 'baruwa_cluster', peer 'baruwadb1:,baruwadb2:,baruwadb3:' Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Warning] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') address 'tcp://172.17.1.12:4567' points to own listening address, blacklisting Sep 29 17:03:36 baruwAdb3 mysqld: 140929 17:03:36 [Note] WSREP: (1475a37f-481c-11e4-b9cc-ee8fe601500f, 'tcp://0.0.0.0:4567') address 'tcp://172.17.1.12:4567' pointing to uuid 1475a37f-481c-11e4-b9cc-ee8fe601500f is blacklisted, skipping Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: declaring 55a2a1b4-481a-11e4-912d-93d52c4f97cc stable Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Node 55a2a1b4-481a-11e4-912d-93d52c4f97cc state prim Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: view(view_id(PRIM,1475a37f-481c-11e4-b9cc-ee8fe601500f,2) memb { Sep 29 17:03:37 baruwAdb3 mysqld: #0111475a37f-481c-11e4-b9cc-ee8fe601500f,0 Sep 29 17:03:37 baruwAdb3 mysqld: #01155a2a1b4-481a-11e4-912d-93d52c4f97cc,0 Sep 29 17:03:37 baruwAdb3 mysqld: } joined { Sep 29 17:03:37 baruwAdb3 mysqld: } left { Sep 29 17:03:37 baruwAdb3 mysqld: } partitioned { Sep 29 17:03:37 baruwAdb3 mysqld: }) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: discarding pending addr without UUID: tcp://172.17.1.4:4567 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: discarding pending addr proto entry 0x7f4043ae18c0 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: gcomm: connected Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Opened channel 'baruwa_cluster' Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Waiting for SST to complete. Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 14c24d3f-481c-11e4-a0af-cae2115c6e2e Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: sent state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: got state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e from 0 (baruwadb3) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: STATE EXCHANGE: got state msg: 14c24d3f-481c-11e4-a0af-cae2115c6e2e from 1 (baruwadb1) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Quorum results: Sep 29 17:03:37 baruwAdb3 mysqld: #011version = 3, Sep 29 17:03:37 baruwAdb3 mysqld: #011component = PRIMARY, Sep 29 17:03:37 baruwAdb3 mysqld: #011conf_id = 1, Sep 29 17:03:37 baruwAdb3 mysqld: #011members = 1/2 (joined/total), Sep 29 17:03:37 baruwAdb3 mysqld: #011act_id = 1, Sep 29 17:03:37 baruwAdb3 mysqld: #011last_appl. = -1, Sep 29 17:03:37 baruwAdb3 mysqld: #011protocols = 0/5/3 (gcs/repl/appl), Sep 29 17:03:37 baruwAdb3 mysqld: #011group UUID = 0c63fe44-47fe-11e4-8d91-d3636a34c2fc Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Flow-control interval: [23, 23] Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1) Sep 29 17:03:37 baruwAdb3 mysqld: 140929 17:03:37 [Warning] WSREP: Gap in state sequence. Need state transfer. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '172.17.1.12' --auth '' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '26706' '' ' Sep 29 17:03:39 baruwAdb3 rsyncd[26804]: rsyncd version 3.1.0 starting, listening on port 4444 Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Prepared SST request: rsync|172.17.1.12:4444/rsync_sst Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: REPL Protocols: 5 (3, 1) Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Service thread queue flushed. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Assign initial position for certification: 1, protocol version: 3 Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Service thread queue flushed. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (0c63fe44-47fe-11e4-8d91-d3636a34c2fc): 1 (Operation not permitted) Sep 29 17:03:39 baruwAdb3 mysqld: #011 at galera/src/replicator_str.cpp:prepare_for_IST():447. IST will be unavailable. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Member 0.0 (baruwadb3) requested state transfer from '*any*'. Selected 1.0 (baruwadb1)(SYNCED) as donor. Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1) Sep 29 17:03:39 baruwAdb3 mysqld: 140929 17:03:39 [Note] WSREP: Requesting state transfer: success, donor: 1 Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: rsync to rsync_sst/ from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:39 baruwAdb3 rsyncd[26819]: receiving file list Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:43 baruwAdb3 rsyncd[26819]: sent 44 bytes received 209,766,748 bytes total size 209,715,200 Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: rsync to rsync_sst-log_dir/ from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:03:43 baruwAdb3 rsyncd[26929]: receiving file list Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted in Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (111 "Connection refused")' Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists! Sep 29 17:04:05 baruwAdb3 /etc/init.d/mysql[27564]: Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[26929]: sent 63 bytes received 1,074,004,182 bytes total size 1,073,741,824 Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: rsync to rsync_sst/./performance_schema from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: rsync to rsync_sst/./sa_bayes from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:14 baruwAdb3 rsyncd[27731]: receiving file list Sep 29 17:04:14 baruwAdb3 rsyncd[27730]: receiving file list Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:15 baruwAdb3 rsyncd[27730]: sent 1,036 bytes received 100,517 bytes total size 96,357 Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: rsync to rsync_sst/./mysql from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:15 baruwAdb3 rsyncd[27758]: receiving file list Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:16 baruwAdb3 rsyncd[27758]: sent 1,682 bytes received 1,139,500 bytes total size 1,133,625 Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: rsync to rsync_sst/./baruwa from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:16 baruwAdb3 rsyncd[27772]: receiving file list Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: connect from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:18 baruwAdb3 rsyncd[27731]: sent 238 bytes received 93,682,655 bytes total size 93,659,026 Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: rsync to rsync_sst/./test from baruwadb1.jovenclub.cu (172.17.1.2) Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: receiving file list Sep 29 17:04:18 baruwAdb3 rsyncd[27818]: sent 48 bytes received 205 bytes total size 61
Thanks for your time. Regards
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
participants (2)
-
Carlos Raúl Laguna -
Nirbhay Choubey