JustPaste.it - Share Text & Images the Easy Way

px1.px1.px1.px1 - PXC Node1 IP
px2.px2.px2.px2 - PXC Node2 IP
px3.px3.px3.px3 - PXC Node3 IP
px4.px4.px4.px4 - PXC Node3 IP

PXC4
/var/log/messages
[CODE] 11:42:40 systemd: Starting Percona XtraDB Cluster...
11:42:52 mysqld_safe: 11:42:52.973948Z mysqld_safe Logging to syslog.
11:42:52 mysqld_safe: 11:42:52.976983Z mysqld_safe Logging to '/var/log/mysqld.log'.
11:42:52 mysqld_safe: Logging to '/var/log/mysqld.log'.
11:42:52 mysqld_safe: 11:42:52.979314Z mysqld_safe Logging to '/var/log/mysqld.log'.
11:42:52 mysqld_safe: Logging to '/var/log/mysqld.log'.
11:42:52 mysqld_safe: 11:42:52.995874Z mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
11:42:52 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql
11:42:53 mysqld_safe: 11:42:53.000214Z mysqld_safe Skipping wsrep-recover for empty datadir: /var/lib/mysql
11:42:53 mysqld_safe: Skipping wsrep-recover for empty datadir: /var/lib/mysql
11:42:53 mysqld_safe: 11:42:53.001690Z mysqld_safe Assigning 00000000-0000-0000-0000-000000000000:-1 to wsrep_start_position
11:42:53 mysqld_safe: Assigning 00000000-0000-0000-0000-000000000000:-1 to wsrep_start_position
11:42:53 mysqld[14287]: /usr/sbin/mysqld (mysqld 5.7.19-17-57) starting as process 14287 ...
11:42:53 mysqld[14287]: WSREP: Setting wsrep_ready to false
11:42:53 mysqld[14287]: WSREP: No pre-stored wsrep-start position found. Skipping position initialization.
11:42:53 mysqld[14287]: WSREP: wsrep_load(): loading provider library '/usr/lib64/galera3/libgalera_smm.so'
11:42:53 mysqld[14287]: WSREP: wsrep_load(): Galera 3.22(r8678538) by Codership Oy <info@codership.com> loaded successfully.
11:42:53 mysqld[14287]: WSREP: CRC-32C: using "slicing-by-8" algorithm.
11:42:53 mysqld[14287]: WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat'
11:42:53 mysqld[14287]: WSREP: No persistent state found. Bootstraping with default state
11:42:53 mysqld[14287]: WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootsrap: 1
11:42:53 mysqld[14287]: WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = px1.px1.px1.px1; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 10; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 4; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_count = 0; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 100; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = 1; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 1; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 7; socket.checksum = 2; socket.recv_buf_size = 212992;
11:42:53 mysqld[14287]: WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1
11:42:53 mysqld[14287]: WSREP: Assign initial position for certification: -1, protocol version: -1
11:42:53 mysqld[14287]: WSREP: Preparing to initiate SST/IST
11:42:53 mysqld[14287]: WSREP: Starting replication
11:42:53 mysqld[14287]: WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
11:42:53 mysqld[14287]: WSREP: Using CRC-32C for message checksums.
11:42:53 mysqld[14287]: WSREP: gcomm thread scheduling priority set to other:0
11:42:53 mysqld[14287]: WSREP: Fail to access the file (/var/lib/mysql//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
11:42:53 mysqld[14287]: WSREP: Restoring primary-component from disk failed. Either node is booting for first time or re-booting after a graceful shutdown
11:42:53 mysqld[14287]: WSREP: GMCast version 0
11:42:53 mysqld[14287]: WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
11:42:53 mysqld[14287]: WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
11:42:53 mysqld[14287]: WSREP: EVS version 0
11:42:53 mysqld[14287]: WSREP: gcomm: connecting to group 'paxcluster', peer 'px1.px1.px1.px1:,px2.px2.px2.px2:,px3.px3.px3.px3:'
11:42:53 mysqld[14287]: WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') connection established to e492b6a2 tcp://px1.px1.px1.px1:4567
11:42:53 mysqld[14287]: WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
11:42:53 mysqld[14287]: WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') connection established to 4b03a937 tcp://px2.px2.px2.px2:4567
11:42:53 mysqld[14287]: WSREP: declaring 4b03a937 at tcp://px2.px2.px2.px2:4567 stable
11:42:53 mysqld[14287]: WSREP: declaring e492b6a2 at tcp://px1.px1.px1.px1:4567 stable
11:42:53 mysqld[14287]: WSREP: Node 4b03a937 state primary
11:42:53 mysqld[14287]: WSREP: Current view of cluster as seen by this node#012view (view_id(PRIM,4b03a937,588)#012memb {#012#0114b03a937,0#012#011e492b6a2,0#012#011fb3a7e17,0#012#011}#012joined {#012#011}#012left {#012#011}#012partitioned {#012#011}#012)
11:42:53 mysqld[14287]: WSREP: Save the discovered primary-component to disk
11:42:53 mysqld[14287]: WSREP: discarding pending addr without UUID: tcp://px3.px3.px3.px3:4567
11:42:53 mysqld[14287]: WSREP: gcomm: connected
11:42:53 mysqld[14287]: WSREP: Shifting CLOSED -> OPEN (TO: 0)
11:42:53 mysqld[14287]: WSREP: Waiting for SST/IST to complete.
11:42:53 mysqld[14287]: WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
11:42:53 mysqld[14287]: WSREP: STATE EXCHANGE: Waiting for state UUID.
11:42:53 mysqld[14287]: WSREP: STATE EXCHANGE: sent state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9
11:42:53 mysqld[14287]: WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 0 (PXC2)
11:42:53 mysqld[14287]: WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 1 (PXC1)
11:42:53 mysqld[14287]: WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 2 (PXC4)
11:42:53 mysqld[14287]: WSREP: Quorum results:#012#011version = 4,#012#011component = PRIMARY,#012#011conf_id = 558,#012#011members = 2/3 (primary/total),#012#011act_id = 401105246,#012#011last_appl. = -1,#012#011protocols = 0/7/3 (gcs/repl/appl),#012#011group UUID = 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:53 mysqld[14287]: WSREP: Flow-control interval: [173, 173]
11:42:53 mysqld[14287]: WSREP: Trying to continue unpaused monitor
11:42:53 mysqld[14287]: WSREP: Shifting OPEN -> PRIMARY (TO: 401105246)
11:42:53 mysqld[14287]: WSREP: State transfer required: #012#011Group state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246#012#011Local state: 00000000-0000-0000-0000-000000000000:-1
11:42:53 mysqld[14287]: WSREP: New cluster view: global state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246, view# 559: Primary, number of nodes: 3, my index: 2, protocol version 3
11:42:53 mysqld[14287]: WSREP: Setting wsrep_ready to true
11:42:53 mysqld[14287]: WSREP: Gap in state sequence. Need state transfer.
11:42:53 mysqld[14287]: WSREP: Setting wsrep_ready to false
11:42:53 mysqld[14287]: WSREP: Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address 'px1.px1.px1.px1' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '14287' '' )
11:42:54 mysqld[14287]: WSREP: Prepared SST/IST request: xtrabackup-v2|px1.px1.px1.px1:4444/xtrabackup_sst//1
11:42:54 mysqld[14287]: WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:54 mysqld[14287]: WSREP: REPL Protocols: 7 (3, 2)
11:42:54 mysqld[14287]: WSREP: Assign initial position for certification: 401105246, protocol version: 3
11:42:54 mysqld[14287]: WSREP: Service thread queue flushed.
11:42:54 mysqld[14287]: WSREP: Check if state gap can be serviced using IST
11:42:54 mysqld[14287]: WSREP: Local UUID: 00000000-0000-0000-0000-000000000000 != Group UUID: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:54 mysqld[14287]: WSREP: State gap can't be serviced using IST. Switching to SST
11:42:54 mysqld[14287]: WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6): 1 (Operation not permitted)#012#011 at galera/src/replicator_str.cpp:prepare_for_IST():538. IST will be unavailable.
11:42:54 mysqld[14287]: WSREP: Member 2.0 (PXC4) requested state transfer from '*any*'. Selected 0.0 (PXC2)(SYNCED) as donor.
11:42:54 mysqld[14287]: WSREP: Shifting PRIMARY -> JOINER (TO: 401105267)
11:42:54 mysqld[14287]: WSREP: Requesting state transfer: success, donor: 0
11:42:54 mysqld[14287]: WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246
11:42:54 mysqld[14287]: WSREP: 0.0 (PXC2): State transfer to 2.0 (PXC4) failed: -32 (Broken pipe)
11:42:54 mysqld[14287]: WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():765: Will never receive state. Need to abort.
11:42:54 mysqld[14287]: WSREP: gcomm: terminating thread
11:42:54 mysqld[14287]: WSREP: gcomm: joining thread
11:42:54 mysqld[14287]: WSREP: gcomm: closing backend
11:42:54 mysqld[14287]: WSREP: Current view of cluster as seen by this node#012view (view_id(NON_PRIM,4b03a937,588)#012memb {#012#011fb3a7e17,0#012#011}#012joined {#012#011}#012left {#012#011}#012partitioned {#012#0114b03a937,0#012#011e492b6a2,0#012#011}#012)
11:42:54 mysqld[14287]: WSREP: Current view of cluster as seen by this node#012view ((empty))
11:42:54 mysqld[14287]: WSREP: gcomm: closed
11:42:54 mysqld[14287]: WSREP: /usr/sbin/mysqld: Terminated.
11:42:54 mysqld_safe: /usr/bin/mysqld_safe: line 218: 14287 Aborted nohup /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --wsrep-provider=/usr/lib64/galera3/libgalera_smm.so --log-error=/var/log/mysqld.log --open-files-limit=8192 --pid-file=/run/mysqld/mysql.pid --wsrep_start_position='00000000-0000-0000-0000-000000000000:-1' --log-syslog=1 --log-syslog-facility=daemon '--log-syslog-tag=' < /dev/null > /dev/null 2>&1
11:42:54 systemd: mysql.service: main process exited, code=exited, status=134/n/a
11:42:54 mysql-systemd: /usr/bin/mysql-systemd: line 140: kill: (13853) - No such process
11:42:54 mysql-systemd: ERROR! mysqld_safe with PID 13853 has already exited: FAILURE
11:42:54 systemd: mysql.service: control process exited, code=exited status=1
11:42:54 mysql-systemd: WARNING: mysql pid file /run/mysqld/mysql.pid empty or not readable
11:42:54 mysql-systemd: ERROR! mysql already dead
11:42:54 systemd: mysql.service: control process exited, code=exited status=2
11:42:54 -wsrep-sst-joiner: Removing /var/lib/mysql//xtrabackup_galera_info file due to signal
11:42:54 -wsrep-sst-joiner: Removing file due to signal
11:42:54 -wsrep-sst-joiner: Removing /var/lib/mysql//xtrabackup_galera_info file due to signal
11:42:54 -wsrep-sst-joiner: Removing file due to signal
11:42:54 -wsrep-sst-joiner: ******************* FATAL ERROR **********************
11:42:54 -wsrep-sst-joiner: Error while getting data from donor node: exit codes: 143 143
11:42:54 -wsrep-sst-joiner: ******************************************************
11:42:54 -wsrep-sst-joiner: Cleanup after exit with status:32
11:42:54 mysql-systemd: WARNING: mysql pid file /run/mysqld/mysql.pid empty or not readable
11:42:54 mysql-systemd: WARNING: mysql may be already dead
11:42:54 systemd: Failed to start Percona XtraDB Cluster.
11:42:54 systemd: Unit mysql.service entered failed state.
11:42:54 systemd: mysql.service failed.
[/CODE]

/var/log/secure
[CODE] 11:42:54 polkitd[656]: Unregistered Authentication Agent for unix-process:13754:5709648 (system bus name :1.215, object path /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8) (disconnected from bus)[/CODE]

/var/lib/mysqld.log
[CODE] 11:42:40.499261Z 0 [Warning] option 'wsrep_max_ws_size': unsigned value 4294901759 adjusted to 2147483647
11:42:40.499303Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
11:42:40.499328Z 0 [Warning] WSREP: Node is running in bootstrap/initialize mode. Disabling pxc_strict_mode checks
11:42:40.501876Z 0 [Warning] InnoDB: Using innodb_locks_unsafe_for_binlog is DEPRECATED. This option may be removed in future releases. Please use READ COMMITTED transaction isolation level instead; Please refer to http://dev.mysql.com/doc/refman/5.7/en/set-transaction.html
100 200 300 400 500
100 200 300 400 500
11:42:42.166334Z 0 [Warning] InnoDB: New log files created, LSN=45790
11:42:42.501374Z 0 [Warning] InnoDB: Creating foreign key constraint system tables.
11:42:42.555003Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: f4e51c74-c072-11e7-b521-00505600394b.
11:42:42.559661Z 0 [Warning] Gtid table is not ready to be used. Table 'mysql.gtid_executed' cannot be opened.
11:42:42.748006Z 0 [Warning] CA certificate ca.pem is self signed.
11:42:42.963554Z 1 [Note] A temporary password is generated for root@localhost: arrt*cIok6pR
11:42:53.153729Z 0 [Warning] option 'wsrep_max_ws_size': unsigned value 4294901759 adjusted to 2147483647
11:42:53.153812Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
11:42:53.154708Z 0 [Warning] Insecure configuration for --secure-file-priv: Location is accessible to all OS users. Consider choosing a different directory.
11:42:53.154754Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.19-17-57) starting as process 14287 ...
11:42:53.156670Z 0 [Note] WSREP: Setting wsrep_ready to false
11:42:53.156704Z 0 [Note] WSREP: No pre-stored wsrep-start position found. Skipping position initialization.
11:42:53.156715Z 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera3/libgalera_smm.so'
11:42:53.160678Z 0 [Note] WSREP: wsrep_load(): Galera 3.22(r8678538) by Codership Oy <info@codership.com> loaded successfully.
11:42:53.160740Z 0 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
11:42:53.160990Z 0 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat'
11:42:53.161017Z 0 [Warning] WSREP: No persistent state found. Bootstraping with default state
11:42:53.161067Z 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootsrap: 1
11:42:53.169655Z 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = px1.px1.px1.px1; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 10; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 4; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_count = 0; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 100; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = 1; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 1; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 7; socket.checksum = 2; socket.recv_buf_size = 212992;
11:42:53.177217Z 0 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1
11:42:53.180387Z 0 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
11:42:53.180422Z 0 [Note] WSREP: Preparing to initiate SST/IST
11:42:53.180436Z 0 [Note] WSREP: Starting replication
11:42:53.180459Z 0 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
11:42:53.180650Z 0 [Note] WSREP: Using CRC-32C for message checksums.
11:42:53.180740Z 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
11:42:53.180835Z 0 [Warning] WSREP: Fail to access the file (/var/lib/mysql//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
11:42:53.180851Z 0 [Note] WSREP: Restoring primary-component from disk failed. Either node is booting for first time or re-booting after a graceful shutdown
11:42:53.181011Z 0 [Note] WSREP: GMCast version 0
11:42:53.181236Z 0 [Note] WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
11:42:53.181252Z 0 [Note] WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
11:42:53.181539Z 0 [Note] WSREP: EVS version 0
11:42:53.181645Z 0 [Note] WSREP: gcomm: connecting to group 'paxcluster', peer 'px1.px1.px1.px1:,px2.px2.px2.px2:,px3.px3.px3.px3:'
11:42:53.183373Z 0 [Note] WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') connection established to e492b6a2 tcp://px1.px1.px1.px1:4567
11:42:53.183457Z 0 [Note] WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
11:42:53.183505Z 0 [Note] WSREP: (fb3a7e17, 'tcp://0.0.0.0:4567') connection established to 4b03a937 tcp://px2.px2.px2.px2:4567
11:42:53.299165Z 0 [Note] WSREP: declaring 4b03a937 at tcp://px2.px2.px2.px2:4567 stable
11:42:53.299219Z 0 [Note] WSREP: declaring e492b6a2 at tcp://px1.px1.px1.px1:4567 stable
11:42:53.299661Z 0 [Note] WSREP: Node 4b03a937 state primary
11:42:53.300418Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,4b03a937,588)
memb {
4b03a937,0
e492b6a2,0
fb3a7e17,0
}
joined {
}
left {
}
partitioned {
}
)
11:42:53.300444Z 0 [Note] WSREP: Save the discovered primary-component to disk
11:42:53.300588Z 0 [Note] WSREP: discarding pending addr without UUID: tcp://px3.px3.px3.px3:4567
11:42:53.682147Z 0 [Note] WSREP: gcomm: connected
11:42:53.682263Z 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
11:42:53.682407Z 0 [Note] WSREP: Waiting for SST/IST to complete.
11:42:53.682410Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
11:42:53.682483Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
11:42:53.682537Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9
11:42:53.682551Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 0 (PXC2)
11:42:53.682560Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 1 (PXC1)
11:42:53.683955Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 2 (PXC4)
11:42:53.683987Z 0 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 558,
members = 2/3 (primary/total),
act_id = 401105246,
last_appl. = -1,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:53.683999Z 0 [Note] WSREP: Flow-control interval: [173, 173]
11:42:53.684011Z 0 [Note] WSREP: Trying to continue unpaused monitor
11:42:53.684017Z 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 401105246)
11:42:53.684066Z 1 [Note] WSREP: State transfer required:
Group state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246
Local state: 00000000-0000-0000-0000-000000000000:-1
11:42:53.684086Z 1 [Note] WSREP: New cluster view: global state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246, view# 559: Primary, number of nodes: 3, my index: 2, protocol version 3
11:42:53.684100Z 1 [Note] WSREP: Setting wsrep_ready to true
11:42:53.684108Z 1 [Warning] WSREP: Gap in state sequence. Need state transfer.
11:42:53.684114Z 1 [Note] WSREP: Setting wsrep_ready to false
11:42:53.684165Z 0 [Note] WSREP: Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address 'px1.px1.px1.px1' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '14287' '' )
11:42:53.886111Z WSREP_SST: [INFO] Logging all stderr of SST/XtraBackup to syslog
11:42:54.105279Z 1 [Note] WSREP: Prepared SST/IST request: xtrabackup-v2|px1.px1.px1.px1:4444/xtrabackup_sst//1
11:42:54.105333Z 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:54.105361Z 1 [Note] WSREP: REPL Protocols: 7 (3, 2)
11:42:54.105375Z 1 [Note] WSREP: Assign initial position for certification: 401105246, protocol version: 3
11:42:54.105416Z 0 [Note] WSREP: Service thread queue flushed.
11:42:54.105457Z 1 [Note] WSREP: Check if state gap can be serviced using IST
11:42:54.105476Z 1 [Note] WSREP: Local UUID: 00000000-0000-0000-0000-000000000000 != Group UUID: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:54.105528Z 1 [Note] WSREP: State gap can't be serviced using IST. Switching to SST
11:42:54.105543Z 1 [Note] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6): 1 (Operation not permitted)
at galera/src/replicator_str.cpp:prepare_for_IST():538. IST will be unavailable.
11:42:54.106218Z 0 [Note] WSREP: Member 2.0 (PXC4) requested state transfer from '*any*'. Selected 0.0 (PXC2)(SYNCED) as donor.
11:42:54.106239Z 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 401105267)
11:42:54.106271Z 1 [Note] WSREP: Requesting state transfer: success, donor: 0
11:42:54.106293Z 1 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246
11:42:54.281581Z 0 [Warning] WSREP: 0.0 (PXC2): State transfer to 2.0 (PXC4) failed: -32 (Broken pipe)
11:42:54.281610Z 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():765: Will never receive state. Need to abort.
11:42:54.281624Z 0 [Note] WSREP: gcomm: terminating thread
11:42:54.281639Z 0 [Note] WSREP: gcomm: joining thread
11:42:54.281672Z 0 [Note] WSREP: gcomm: closing backend
11:42:54.282209Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(NON_PRIM,4b03a937,588)
memb {
fb3a7e17,0
}
joined {
}
left {
}
partitioned {
4b03a937,0
e492b6a2,0
}
)
11:42:54.282242Z 0 [Note] WSREP: Current view of cluster as seen by this node
view ((empty))
11:42:54.282361Z 0 [Note] WSREP: gcomm: closed
11:42:54.282378Z 0 [Note] WSREP: /usr/sbin/mysqld: Terminated.[/CODE]

PXC1
/var/lib/mysqld.log
[CODE] 11:42:54 11498 [Note] WSREP: (e492b6a2, 'tcp://0.0.0.0:4567') connection established to fb3a7e17 tcp://px4.px4.px4.px4:4567
11:42:54 11498 [Note] WSREP: (e492b6a2, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
11:42:54 11498 [Note] WSREP: declaring 4b03a937 at tcp://px2.px2.px2.px2:4567 stable
11:42:54 11498 [Note] WSREP: declaring fb3a7e17 at tcp://px4.px4.px4.px4:4567 stable
11:42:54 11498 [Note] WSREP: Node 4b03a937 state prim
11:42:54 11498 [Note] WSREP: view(view_id(PRIM,4b03a937,588) memb {
4b03a937,0
e492b6a2,0
fb3a7e17,0
} joined {
} left {
} partitioned {
})
11:42:54 11498 [Note] WSREP: save pc into disk
11:42:54 11498 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
11:42:54 11498 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
11:42:54 11498 [Note] WSREP: STATE EXCHANGE: sent state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9
11:42:54 11498 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 0 (PXC2)
11:42:54 11498 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 1 (PXC1)
11:42:54 11498 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 2 (PXC4)
11:42:54 11498 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 558,
members = 2/3 (joined/total),
act_id = 401105246,
last_appl. = 401105190,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:54 11498 [Note] WSREP: Flow-control interval: [28, 28]
11:42:54 11498 [Note] WSREP: New cluster view: global state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246, view# 559: Primary, number of nodes: 3, my index: 1, protocol version 3
11:42:54 11498 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:54 11498 [Note] WSREP: REPL Protocols: 7 (3, 2)
11:42:54 11498 [Note] WSREP: Assign initial position for certification: 401105246, protocol version: 3
11:42:54 11498 [Note] WSREP: Service thread queue flushed.
11:42:55 11498 [Note] WSREP: Member 2.0 (PXC4) requested state transfer from '*any*'. Selected 0.0 (PXC2)(SYNCED) as donor.
11:42:55 11498 [Warning] WSREP: 0.0 (PXC2): State transfer to 2.0 (PXC4) failed: -32 (Broken pipe)
11:42:55 11498 [Note] WSREP: declaring 4b03a937 at tcp://px2.px2.px2.px2:4567 stable
11:42:55 11498 [Note] WSREP: forgetting fb3a7e17 (tcp://px4.px4.px4.px4:4567)
11:42:55 11498 [Note] WSREP: Member 0.0 (PXC2) synced with group.
11:42:55 11498 [Note] WSREP: Node 4b03a937 state prim
11:42:55 11498 [Note] WSREP: view(view_id(PRIM,4b03a937,589) memb {
4b03a937,0
e492b6a2,0
} joined {
} left {
} partitioned {
fb3a7e17,0
})
11:42:55 11498 [Note] WSREP: save pc into disk
11:42:55 11498 [Note] WSREP: forgetting fb3a7e17 (tcp://px4.px4.px4.px4:4567)
11:42:55 11498 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
11:42:55 11498 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
11:42:55 11498 [Note] WSREP: STATE EXCHANGE: sent state msg: fc707e04-c072-11e7-823c-83efb6287c96
11:42:55 11498 [Note] WSREP: STATE EXCHANGE: got state msg: fc707e04-c072-11e7-823c-83efb6287c96 from 0 (PXC2)
11:42:55 11498 [Note] WSREP: STATE EXCHANGE: got state msg: fc707e04-c072-11e7-823c-83efb6287c96 from 1 (PXC1)
11:42:55 11498 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 559,
members = 2/2 (joined/total),
act_id = 401105273,
last_appl. = 401105190,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:55 11498 [Note] WSREP: Flow-control interval: [23, 23]
11:42:55 11498 [Note] WSREP: New cluster view: global state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105273, view# 560: Primary, number of nodes: 2, my index: 1, protocol version 3
11:42:55 11498 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:55 11498 [Note] WSREP: REPL Protocols: 7 (3, 2)
11:42:55 11498 [Note] WSREP: Assign initial position for certification: 401105273, protocol version: 3
11:42:55 11498 [Note] WSREP: Service thread queue flushed.
11:42:57 11498 [Note] WSREP: (e492b6a2, 'tcp://0.0.0.0:4567') turning message relay requesting off
11:43:00 11498 [Note] WSREP: cleaning up fb3a7e17 (tcp://px4.px4.px4.px4:4567)[/CODE]

PXC2
/var/log/mysqld.log
[CODE] 11:42:54.112007Z 0 [Note] WSREP: (4b03a937, 'tcp://0.0.0.0:4567') connection established to fb3a7e17 tcp://px4.px4.px4.px4:4567
11:42:54.112231Z 0 [Note] WSREP: (4b03a937, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
11:42:54.228000Z 0 [Note] WSREP: declaring e492b6a2 at tcp://px1.px1.px1.px1:4567 stable
11:42:54.228074Z 0 [Note] WSREP: declaring fb3a7e17 at tcp://px4.px4.px4.px4:4567 stable
11:42:54.228541Z 0 [Note] WSREP: Node 4b03a937 state primary
11:42:54.229183Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,4b03a937,588)
memb {
4b03a937,0
e492b6a2,0
fb3a7e17,0
}
joined {
}
left {
}
partitioned {
}
)
11:42:54.229209Z 0 [Note] WSREP: Save the discovered primary-component to disk
11:42:54.229429Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
11:42:54.229762Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9
11:42:54.230452Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9
11:42:54.230961Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 0 (PXC2)
11:42:54.230988Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 1 (PXC1)
11:42:54.612768Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fbda7e35-c072-11e7-ade6-4ab94a7ffcd9 from 2 (PXC4)
11:42:54.612872Z 0 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 558,
members = 2/3 (primary/total),
act_id = 401105246,
last_appl. = 401105190,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:54.612899Z 0 [Note] WSREP: Flow-control interval: [173, 173]
11:42:54.612985Z 7 [Note] WSREP: New cluster view: global state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105246, view# 559: Primary, number of nodes: 3, my index: 0, protocol version 3
11:42:54.613012Z 7 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:54.613034Z 7 [Note] WSREP: REPL Protocols: 7 (3, 2)
11:42:54.613163Z 7 [Note] WSREP: Assign initial position for certification: 401105246, protocol version: 3
11:42:54.613205Z 0 [Note] WSREP: Service thread queue flushed.
11:42:55.035136Z 0 [Note] WSREP: Member 2.0 (PXC4) requested state transfer from '*any*'. Selected 0.0 (PXC2)(SYNCED) as donor.
11:42:55.035189Z 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 401105267)
11:42:55.035219Z 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:55.035312Z 0 [Note] WSREP: Initiating SST/IST transfer on DONOR side (wsrep_sst_xtrabackup-v2 --role 'donor' --address 'px1.px1.px1.px1:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105267')
11:42:55.035500Z 10 [Note] WSREP: DONOR thread signaled with 0
11:42:55.185996Z WSREP_SST: [INFO] Logging all stderr of SST/XtraBackup to syslog
11:42:55.209638Z 0 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'px1.px1.px1.px1:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105267': 32 (Broken pipe)
11:42:55.209725Z 0 [ERROR] WSREP: Command did not run: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'px1.px1.px1.px1:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105267'
11:42:55.210347Z 0 [Warning] WSREP: 0.0 (PXC2): State transfer to 2.0 (PXC4) failed: -32 (Broken pipe)
11:42:55.210374Z 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 401105273)
11:42:55.211239Z 0 [Note] WSREP: Member 0.0 (PXC2) synced with group.
11:42:55.211249Z 0 [Note] WSREP: declaring e492b6a2 at tcp://px1.px1.px1.px1:4567 stable
11:42:55.211260Z 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 401105273)
11:42:55.211285Z 0 [Note] WSREP: forgetting fb3a7e17 (tcp://px4.px4.px4.px4:4567)
11:42:55.211321Z 10 [Note] WSREP: Synchronized with group, ready for connections
11:42:55.211355Z 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:55.211852Z 0 [Note] WSREP: Node 4b03a937 state primary
11:42:55.212262Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,4b03a937,589)
memb {
4b03a937,0
e492b6a2,0
}
joined {
}
left {
}
partitioned {
fb3a7e17,0
}
)
11:42:55.212297Z 0 [Note] WSREP: Save the discovered primary-component to disk
11:42:55.212450Z 0 [Note] WSREP: forgetting fb3a7e17 (tcp://px4.px4.px4.px4:4567)
11:42:55.212469Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
11:42:55.212958Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: fc707e04-c072-11e7-823c-83efb6287c96
11:42:55.213290Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fc707e04-c072-11e7-823c-83efb6287c96
11:42:55.213775Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fc707e04-c072-11e7-823c-83efb6287c96 from 0 (PXC2)
11:42:55.214096Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: fc707e04-c072-11e7-823c-83efb6287c96 from 1 (PXC1)
11:42:55.214120Z 0 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 559,
members = 2/2 (primary/total),
act_id = 401105273,
last_appl. = 401105190,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6
11:42:55.214139Z 0 [Note] WSREP: Flow-control interval: [141, 141]
11:42:55.214184Z 2 [Note] WSREP: New cluster view: global state: 3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105273, view# 560: Primary, number of nodes: 2, my index: 0, protocol version 3
11:42:55.214211Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
11:42:55.214226Z 2 [Note] WSREP: REPL Protocols: 7 (3, 2)
11:42:55.214306Z 2 [Note] WSREP: Assign initial position for certification: 401105273, protocol version: 3
11:42:55.214342Z 0 [Note] WSREP: Service thread queue flushed.
11:42:57.395737Z 0 [Note] WSREP: (4b03a937, 'tcp://0.0.0.0:4567') turning message relay requesting off
11:43:00.395850Z 0 [Note] WSREP: cleaning up fb3a7e17 (tcp://px4.px4.px4.px4:4567)[/CODE]