Peter Reilly
2017-05-31 19:56:18 UTC
I have a new configuration of packetfence, and I'm stuck at the final
section of the guide: Checking the MariaDB sync.
I'm new to MariaDB clustering. Any help would be appreciated. Thanks!
Issuing mysql> show status like 'wsrep%'; shows:
wsrep_apply_oooe 0.000000
wsrep_apply_oool 0.000000
wsrep_apply_window 1.000000
wsrep_causal_reads 0
wsrep_cert_deps_distance 1.500000
wsrep_cert_index_size 6
wsrep_cert_interval 0.000000
wsrep_cluster_conf_id 91
wsrep_cluster_size 2
wsrep_cluster_state_uuid d53707fc-462e-11e7-9e94-2307d1d8c35a
wsrep_cluster_status Primary
wsrep_commit_oooe 0.000000
wsrep_commit_oool 0.000000
wsrep_commit_window 1.000000
wsrep_connected ON
wsrep_desync_count 1
wsrep_evs_delayed
02bbf569-4637-11e7-b3bd-475698c96cee:tcp://10.18.0.38:4567:2,07b40a38-4636-11e7-96ad-8356df2560a3:tcp://10.18.0.38:4567:2,0bdbe92c-4639-11e7-bd9f-5ef6eacc266d:tcp://10.18.0.38:4567:2,0d6af863-4635-11e7-b534-065ae24e0e14:tcp://10.18.0.38:4567:1,119bc620-4638-11e7-8c60-1f44bae4b807:tcp://10.18.0.38:4567:2,13002f75-4634-11e7-a038-2206d6fbb42d:tcp://10.18.0.38:4567:2,17864215-4637-11e7-baed-87a29423c2d7:tcp://10.18.0.38:4567:1,1cc5fffc-4636-11e7-9611-b316acb7efd8:tcp://10.18.0.38:4567:4,20f0aa1f-4639-11e7-b9e2-26ed5e81aa1f:tcp://10.18.0.38:4567:5,2233a2eb-4635-11e7-8b9e-ab9cb722ae49:tcp://10.18.0.38:4567:1,266bcf47-4638-11e7-a0e4-96c21bef49e7:tcp://10.18.0.38:4567:4,28121797-4634-11e7-bcfe-56e8bb6c19b7:tcp://10.18.0.38:4567:3,2c4f5b44-4637-11e7-8213-93a3892fcf15:tcp://10.18.0.38:4567:3,35b7c77a-4639-11e7-9475-534e43ccb537:tcp://10.18.0.38:4567:3,37506d89-4635-11e7-8dc9-b7fcdffd54b7:tcp://10.18.0.38:4567:2,3b3344a8-4638-11e7-a347-96ac9e947fb6:tcp://10.18.0.38:4567:2,3ce12393-4634-11e7-a81f-c2a8c8de2496:tcp://10.18.0.38:4567:1,4114e63d-4637-11e7-b030-7efc7248d13f:tcp://10.18.0.38:4567:2,46a3ea11-4636-11e7-8fda-13eadcade32c:tcp://10.18.0.38:4567:4,4a8097a4-4639-11e7-bf2a-533999db367c:tcp://10.18.0.38:4567:3,4c17ad42-4635-11e7-b6e6-d315ee85be43:tcp://10.18.0.38:4567:4,50468a8e-4638-11e7-8601-1617155ed644:tcp://10.18.0.38:4567:2,51a6cd8b-4634-11e7-8a97-fad9fee5825c:tcp://10.18.0.38:4567:3,55da74f8-4637-11e7-a998-769b9f8e1983:tcp://10.18.0.38:4567:4,5b6cbebf-4636-11e7-a547-0641a36aa6e9:tcp://10.18.0.38:4567:3,5f47c624-4639-11e7-947c-6e7cf852e708:tcp://10.18.0.38:4567:2,60e069b1-4635-11e7-aeae-d77204b723ef:tcp://10.18.0.38:4567:3,650de7fc-4638-11e7-b6d9-827cc491159f:tcp://10.18.0.38:4567:2,6673fcbd-4634-11e7-80b0-0283b8f039e0:tcp://10.18.0.38:4567:2,6aa4abb6-4637-11e7-9ea7-0ebb92fd544f:tcp://10.18.0.38:4567:1,6c5aea5a-4633-11e7-9601-1b63974f512e:tcp://10.18.0.38:4567:4,70313a6d-4636-11e7-bc4c-eec94e18edfc:tcp://10.18.0.38:4567:1,75ac13d0-4635-11e7-9b79-3a8f9493d61d:tcp://10.18.0.38:4567:3,79d4f68b-4638-11e7-9269-d2d28710d4f
wsrep_evs_evict_list |
wsrep_evs_repl_latency 0.000296411/0.000296411/0.000296411/0/1
wsrep_evs_state GATHER
wsrep_flow_control_paused 0.000000
wsrep_flow_control_paused_ns 0
wsrep_flow_control_recv 0
wsrep_flow_control_sent 0
wsrep_gcomm_uuid d53696c2-462e-11e7-96e9-73b1bf863e3e
wsrep_incoming_addresses 10.18.0.36:3306,10.18.0.37:3306
wsrep_last_committed 6
wsrep_local_bf_aborts 0
wsrep_local_cached_downto 1
wsrep_local_cert_failures 0
wsrep_local_commits 6
wsrep_local_index 1
wsrep_local_recv_queue 0
wsrep_local_recv_queue_avg 0.045627
wsrep_local_recv_queue_max 2
wsrep_local_recv_queue_min 0
wsrep_local_replays 0
wsrep_local_send_queue 0
wsrep_local_send_queue_avg 0.000000
wsrep_local_send_queue_max 1
wsrep_local_send_queue_min 0
wsrep_local_state 2
wsrep_local_state_comment Donor/Desynced
wsrep_local_state_uuid d53707fc-462e-11e7-9e94-2307d1d8c35a
wsrep_protocol_version 7
wsrep_provider_name Galera
wsrep_provider_vendor Codership
wsrep_provider_version 25.3.19(r3667)
wsrep_ready OFF
wsrep_received 263
wsrep_received_bytes 53338
wsrep_repl_data_bytes 2028
wsrep_repl_keys 22
wsrep_repl_keys_bytes 314
wsrep_repl_other_bytes 0
wsrep_replicated 6
wsrep_replicated_bytes 2726
wsrep_thread_count 2
The log shows the following.
tail -n 500 /var/lib/mysql/o-packetfence02-tdv.wctnet.org.err | grep
-v 'A mysqld process already exists'
2017-05-31 15:52:57 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:52:57 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:52:59 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive
peers: tcp://10.18.0.38:4567
2017-05-31 15:53:00 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') reconnecting to ad66a165 (tcp://10.18.0.38:4567),
attempt 0
2017-05-31 15:53:03 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:03 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:53:03 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,527) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
})
2017-05-31 15:53:03 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:03 140202702010112 [Note] WSREP: forgetting ad66a165
(tcp://10.18.0.38:4567)
2017-05-31 15:53:03 140202702010112 [Note] WSREP: deleting entry
tcp://10.18.0.38:4567
2017-05-31 15:53:03 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting off
2017-05-31 15:53:03 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE: sent
state msg: c1ddf18e-463a-11e7-8d7c-63040f09c269
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: c1ddf18e-463a-11e7-8d7c-63040f09c269 from 0
(o-packetfence01-tdv.wctnet.org)
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: c1ddf18e-463a-11e7-8d7c-63040f09c269 from 1
(o-packetfence02-tdv.wctnet.org)
2017-05-31 15:53:03 140202693617408 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 106,
members = 1/2 (joined/total),
act_id = 6,
last_appl. = 0,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = d53707fc-462e-11e7-9e94-2307d1d8c35a
2017-05-31 15:53:03 140202693617408 [Note] WSREP: Flow-control interval:
[23, 23]
2017-05-31 15:53:03 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# 107:
Primary, number of nodes: 2, my index: 1, protocol version 3
2017-05-31 15:53:03 140202996570880 [Note] WSREP: REPL Protocols: 7 (3, 2)
2017-05-31 15:53:03 140202996570880 [Note] WSREP: Assign initial
position for certification: 6, protocol version: 3
2017-05-31 15:53:03 140202751923968 [Note] WSREP: Service thread queue
flushed.
2017-05-31 15:53:03 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:03 140202702010112 [Note] WSREP: remote endpoint
tcp://10.18.0.38:4567 changed identity ad66a165 -> c23cc2a6
2017-05-31 15:53:03 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2017-05-31 15:53:07 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting off
2017-05-31 15:53:09 140202702010112 [Note] WSREP:
view(view_id(NON_PRIM,6bac5196,527) memb {
d53696c2,0
} joined {
} left {
} partitioned {
6bac5196,0
})
2017-05-31 15:53:09 140202702010112 [Note] WSREP: declaring c23cc2a6 at
tcp://10.18.0.38:4567 stable
2017-05-31 15:53:09 140202693617408 [Note] WSREP: New COMPONENT: primary
= no, bootstrap = no, my_idx = 0, memb_num = 1
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Flow-control interval:
[16, 16]
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Received NON-PRIMARY.
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Shifting
DONOR/DESYNCED -> OPEN (TO: 6)
2017-05-31 15:53:09 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# -1:
non-Primary, number of nodes: 1, my index: 0, protocol version 3
2017-05-31 15:53:09 140202702010112 [Note] WSREP:
view(view_id(NON_PRIM,c23cc2a6,528) memb {
c23cc2a6,0
d53696c2,0
} joined {
} left {
} partitioned {
6bac5196,0
})
2017-05-31 15:53:09 140202693617408 [Note] WSREP: New COMPONENT: primary
= no, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Flow-control interval:
[23, 23]
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Received NON-PRIMARY.
2017-05-31 15:53:09 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# -1:
non-Primary, number of nodes: 2, my index: 1, protocol version 3
2017-05-31 15:53:15 140202702010112 [Note] WSREP:
view(view_id(NON_PRIM,c23cc2a6,528) memb {
d53696c2,0
} joined {
} left {
} partitioned {
6bac5196,0
c23cc2a6,0
})
2017-05-31 15:53:15 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:15 140202693617408 [Note] WSREP: New COMPONENT: primary
= no, bootstrap = no, my_idx = 0, memb_num = 1
2017-05-31 15:53:15 140202693617408 [Note] WSREP: Flow-control interval:
[16, 16]
2017-05-31 15:53:15 140202693617408 [Note] WSREP: Received NON-PRIMARY.
2017-05-31 15:53:15 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# -1:
non-Primary, number of nodes: 1, my index: 0, protocol version 3
2017-05-31 15:53:15 140202702010112 [Note] WSREP: re-bootstrapping prim
from partitioned components
2017-05-31 15:53:15 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,529) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
c23cc2a6,0
})
2017-05-31 15:53:15 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:15 140202702010112 [Note] WSREP: forgetting c23cc2a6
(tcp://10.18.0.38:4567)
2017-05-31 15:53:15 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:15 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:16 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:16 140202702010112 [Warning] WSREP: discarding
established (time wait) c23cc2a6 (tcp://10.18.0.38:4567)
2017-05-31 15:53:18 140202702010112 [Note] WSREP: cleaning up c23cc2a6
(tcp://10.18.0.38:4567)
2017-05-31 15:53:20 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:20 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:53:20 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,530) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
})
2017-05-31 15:53:20 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:20 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE: sent
state msg: cc018bb6-463a-11e7-abec-4e72ee8449eb
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: cc018bb6-463a-11e7-abec-4e72ee8449eb from 0
(o-packetfence01-tdv.wctnet.org)
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: cc018bb6-463a-11e7-abec-4e72ee8449eb from 1
(o-packetfence02-tdv.wctnet.org)
2017-05-31 15:53:20 140202693617408 [Warning] WSREP: Quorum: No node
with complete state:
Version : 4
Flags : 0x1
Protocols : 0 / 7 / 3
State : NON-PRIMARY
Desync count : 0
Prim state : JOINER
Prim UUID : c1ddf18e-463a-11e7-8d7c-63040f09c269
Prim seqno : 107
First seqno : -1
Last seqno : 6
Prim JOINED : 1
State UUID : cc018bb6-463a-11e7-abec-4e72ee8449eb
Group UUID : d53707fc-462e-11e7-9e94-2307d1d8c35a
Name : 'o-packetfence01-tdv.wctnet.org'
Incoming addr: '10.18.0.36:3306'
Version : 4
Flags : 0x2
Protocols : 0 / 7 / 3
State : NON-PRIMARY
Desync count : 1
Prim state : DONOR
Prim UUID : c1ddf18e-463a-11e7-8d7c-63040f09c269
Prim seqno : 107
First seqno : 1
Last seqno : 6
Prim JOINED : 1
State UUID : cc018bb6-463a-11e7-abec-4e72ee8449eb
Group UUID : d53707fc-462e-11e7-9e94-2307d1d8c35a
Name : 'o-packetfence02-tdv.wctnet.org'
Incoming addr: '10.18.0.37:3306'
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Full re-merge of
primary c1ddf18e-463a-11e7-8d7c-63040f09c269 found: 1 of 1.
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 107,
members = 1/2 (joined/total),
act_id = 6,
last_appl. = 0,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = d53707fc-462e-11e7-9e94-2307d1d8c35a
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Flow-control interval:
[23, 23]
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Restored state OPEN ->
DONOR/DESYNCED (6)
2017-05-31 15:53:20 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# 108:
Primary, number of nodes: 2, my index: 1, protocol version 3
2017-05-31 15:53:20 140202996570880 [Note] WSREP: REPL Protocols: 7 (3, 2)
2017-05-31 15:53:20 140202996570880 [Note] WSREP: Assign initial
position for certification: 6, protocol version: 3
2017-05-31 15:53:20 140202751923968 [Note] WSREP: Service thread queue
flushed.
2017-05-31 15:53:20 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:20 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2017-05-31 15:53:24 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting off
2017-05-31 15:53:27 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:27 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:53:27 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,531) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
})
2017-05-31 15:53:27 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:27 140202702010112 [Note] WSREP: forgetting c23cc2a6
(tcp://10.18.0.38:4567)
2017-05-31 15:53:27 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:27 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:28 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:28 140202702010112 [Warning] WSREP: discarding
established (time wait) c23cc2a6 (tcp://10.18.0.38:4567)
2017-05-31 15:53:30 140202702010112 [Note] WSREP: cleaning up c23cc2a6
(tcp://10.18.0.38:4567)
section of the guide: Checking the MariaDB sync.
I'm new to MariaDB clustering. Any help would be appreciated. Thanks!
Issuing mysql> show status like 'wsrep%'; shows:
wsrep_apply_oooe 0.000000
wsrep_apply_oool 0.000000
wsrep_apply_window 1.000000
wsrep_causal_reads 0
wsrep_cert_deps_distance 1.500000
wsrep_cert_index_size 6
wsrep_cert_interval 0.000000
wsrep_cluster_conf_id 91
wsrep_cluster_size 2
wsrep_cluster_state_uuid d53707fc-462e-11e7-9e94-2307d1d8c35a
wsrep_cluster_status Primary
wsrep_commit_oooe 0.000000
wsrep_commit_oool 0.000000
wsrep_commit_window 1.000000
wsrep_connected ON
wsrep_desync_count 1
wsrep_evs_delayed
02bbf569-4637-11e7-b3bd-475698c96cee:tcp://10.18.0.38:4567:2,07b40a38-4636-11e7-96ad-8356df2560a3:tcp://10.18.0.38:4567:2,0bdbe92c-4639-11e7-bd9f-5ef6eacc266d:tcp://10.18.0.38:4567:2,0d6af863-4635-11e7-b534-065ae24e0e14:tcp://10.18.0.38:4567:1,119bc620-4638-11e7-8c60-1f44bae4b807:tcp://10.18.0.38:4567:2,13002f75-4634-11e7-a038-2206d6fbb42d:tcp://10.18.0.38:4567:2,17864215-4637-11e7-baed-87a29423c2d7:tcp://10.18.0.38:4567:1,1cc5fffc-4636-11e7-9611-b316acb7efd8:tcp://10.18.0.38:4567:4,20f0aa1f-4639-11e7-b9e2-26ed5e81aa1f:tcp://10.18.0.38:4567:5,2233a2eb-4635-11e7-8b9e-ab9cb722ae49:tcp://10.18.0.38:4567:1,266bcf47-4638-11e7-a0e4-96c21bef49e7:tcp://10.18.0.38:4567:4,28121797-4634-11e7-bcfe-56e8bb6c19b7:tcp://10.18.0.38:4567:3,2c4f5b44-4637-11e7-8213-93a3892fcf15:tcp://10.18.0.38:4567:3,35b7c77a-4639-11e7-9475-534e43ccb537:tcp://10.18.0.38:4567:3,37506d89-4635-11e7-8dc9-b7fcdffd54b7:tcp://10.18.0.38:4567:2,3b3344a8-4638-11e7-a347-96ac9e947fb6:tcp://10.18.0.38:4567:2,3ce12393-4634-11e7-a81f-c2a8c8de2496:tcp://10.18.0.38:4567:1,4114e63d-4637-11e7-b030-7efc7248d13f:tcp://10.18.0.38:4567:2,46a3ea11-4636-11e7-8fda-13eadcade32c:tcp://10.18.0.38:4567:4,4a8097a4-4639-11e7-bf2a-533999db367c:tcp://10.18.0.38:4567:3,4c17ad42-4635-11e7-b6e6-d315ee85be43:tcp://10.18.0.38:4567:4,50468a8e-4638-11e7-8601-1617155ed644:tcp://10.18.0.38:4567:2,51a6cd8b-4634-11e7-8a97-fad9fee5825c:tcp://10.18.0.38:4567:3,55da74f8-4637-11e7-a998-769b9f8e1983:tcp://10.18.0.38:4567:4,5b6cbebf-4636-11e7-a547-0641a36aa6e9:tcp://10.18.0.38:4567:3,5f47c624-4639-11e7-947c-6e7cf852e708:tcp://10.18.0.38:4567:2,60e069b1-4635-11e7-aeae-d77204b723ef:tcp://10.18.0.38:4567:3,650de7fc-4638-11e7-b6d9-827cc491159f:tcp://10.18.0.38:4567:2,6673fcbd-4634-11e7-80b0-0283b8f039e0:tcp://10.18.0.38:4567:2,6aa4abb6-4637-11e7-9ea7-0ebb92fd544f:tcp://10.18.0.38:4567:1,6c5aea5a-4633-11e7-9601-1b63974f512e:tcp://10.18.0.38:4567:4,70313a6d-4636-11e7-bc4c-eec94e18edfc:tcp://10.18.0.38:4567:1,75ac13d0-4635-11e7-9b79-3a8f9493d61d:tcp://10.18.0.38:4567:3,79d4f68b-4638-11e7-9269-d2d28710d4f
wsrep_evs_evict_list |
wsrep_evs_repl_latency 0.000296411/0.000296411/0.000296411/0/1
wsrep_evs_state GATHER
wsrep_flow_control_paused 0.000000
wsrep_flow_control_paused_ns 0
wsrep_flow_control_recv 0
wsrep_flow_control_sent 0
wsrep_gcomm_uuid d53696c2-462e-11e7-96e9-73b1bf863e3e
wsrep_incoming_addresses 10.18.0.36:3306,10.18.0.37:3306
wsrep_last_committed 6
wsrep_local_bf_aborts 0
wsrep_local_cached_downto 1
wsrep_local_cert_failures 0
wsrep_local_commits 6
wsrep_local_index 1
wsrep_local_recv_queue 0
wsrep_local_recv_queue_avg 0.045627
wsrep_local_recv_queue_max 2
wsrep_local_recv_queue_min 0
wsrep_local_replays 0
wsrep_local_send_queue 0
wsrep_local_send_queue_avg 0.000000
wsrep_local_send_queue_max 1
wsrep_local_send_queue_min 0
wsrep_local_state 2
wsrep_local_state_comment Donor/Desynced
wsrep_local_state_uuid d53707fc-462e-11e7-9e94-2307d1d8c35a
wsrep_protocol_version 7
wsrep_provider_name Galera
wsrep_provider_vendor Codership
wsrep_provider_version 25.3.19(r3667)
wsrep_ready OFF
wsrep_received 263
wsrep_received_bytes 53338
wsrep_repl_data_bytes 2028
wsrep_repl_keys 22
wsrep_repl_keys_bytes 314
wsrep_repl_other_bytes 0
wsrep_replicated 6
wsrep_replicated_bytes 2726
wsrep_thread_count 2
The log shows the following.
tail -n 500 /var/lib/mysql/o-packetfence02-tdv.wctnet.org.err | grep
-v 'A mysqld process already exists'
2017-05-31 15:52:57 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:52:57 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:52:59 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive
peers: tcp://10.18.0.38:4567
2017-05-31 15:53:00 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') reconnecting to ad66a165 (tcp://10.18.0.38:4567),
attempt 0
2017-05-31 15:53:03 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:03 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:53:03 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,527) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
})
2017-05-31 15:53:03 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:03 140202702010112 [Note] WSREP: forgetting ad66a165
(tcp://10.18.0.38:4567)
2017-05-31 15:53:03 140202702010112 [Note] WSREP: deleting entry
tcp://10.18.0.38:4567
2017-05-31 15:53:03 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting off
2017-05-31 15:53:03 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE: sent
state msg: c1ddf18e-463a-11e7-8d7c-63040f09c269
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: c1ddf18e-463a-11e7-8d7c-63040f09c269 from 0
(o-packetfence01-tdv.wctnet.org)
2017-05-31 15:53:03 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: c1ddf18e-463a-11e7-8d7c-63040f09c269 from 1
(o-packetfence02-tdv.wctnet.org)
2017-05-31 15:53:03 140202693617408 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 106,
members = 1/2 (joined/total),
act_id = 6,
last_appl. = 0,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = d53707fc-462e-11e7-9e94-2307d1d8c35a
2017-05-31 15:53:03 140202693617408 [Note] WSREP: Flow-control interval:
[23, 23]
2017-05-31 15:53:03 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# 107:
Primary, number of nodes: 2, my index: 1, protocol version 3
2017-05-31 15:53:03 140202996570880 [Note] WSREP: REPL Protocols: 7 (3, 2)
2017-05-31 15:53:03 140202996570880 [Note] WSREP: Assign initial
position for certification: 6, protocol version: 3
2017-05-31 15:53:03 140202751923968 [Note] WSREP: Service thread queue
flushed.
2017-05-31 15:53:03 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:03 140202702010112 [Note] WSREP: remote endpoint
tcp://10.18.0.38:4567 changed identity ad66a165 -> c23cc2a6
2017-05-31 15:53:03 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2017-05-31 15:53:07 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting off
2017-05-31 15:53:09 140202702010112 [Note] WSREP:
view(view_id(NON_PRIM,6bac5196,527) memb {
d53696c2,0
} joined {
} left {
} partitioned {
6bac5196,0
})
2017-05-31 15:53:09 140202702010112 [Note] WSREP: declaring c23cc2a6 at
tcp://10.18.0.38:4567 stable
2017-05-31 15:53:09 140202693617408 [Note] WSREP: New COMPONENT: primary
= no, bootstrap = no, my_idx = 0, memb_num = 1
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Flow-control interval:
[16, 16]
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Received NON-PRIMARY.
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Shifting
DONOR/DESYNCED -> OPEN (TO: 6)
2017-05-31 15:53:09 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# -1:
non-Primary, number of nodes: 1, my index: 0, protocol version 3
2017-05-31 15:53:09 140202702010112 [Note] WSREP:
view(view_id(NON_PRIM,c23cc2a6,528) memb {
c23cc2a6,0
d53696c2,0
} joined {
} left {
} partitioned {
6bac5196,0
})
2017-05-31 15:53:09 140202693617408 [Note] WSREP: New COMPONENT: primary
= no, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Flow-control interval:
[23, 23]
2017-05-31 15:53:09 140202693617408 [Note] WSREP: Received NON-PRIMARY.
2017-05-31 15:53:09 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# -1:
non-Primary, number of nodes: 2, my index: 1, protocol version 3
2017-05-31 15:53:15 140202702010112 [Note] WSREP:
view(view_id(NON_PRIM,c23cc2a6,528) memb {
d53696c2,0
} joined {
} left {
} partitioned {
6bac5196,0
c23cc2a6,0
})
2017-05-31 15:53:15 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:15 140202693617408 [Note] WSREP: New COMPONENT: primary
= no, bootstrap = no, my_idx = 0, memb_num = 1
2017-05-31 15:53:15 140202693617408 [Note] WSREP: Flow-control interval:
[16, 16]
2017-05-31 15:53:15 140202693617408 [Note] WSREP: Received NON-PRIMARY.
2017-05-31 15:53:15 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# -1:
non-Primary, number of nodes: 1, my index: 0, protocol version 3
2017-05-31 15:53:15 140202702010112 [Note] WSREP: re-bootstrapping prim
from partitioned components
2017-05-31 15:53:15 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,529) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
c23cc2a6,0
})
2017-05-31 15:53:15 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:15 140202702010112 [Note] WSREP: forgetting c23cc2a6
(tcp://10.18.0.38:4567)
2017-05-31 15:53:15 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:15 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:16 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:16 140202702010112 [Warning] WSREP: discarding
established (time wait) c23cc2a6 (tcp://10.18.0.38:4567)
2017-05-31 15:53:18 140202702010112 [Note] WSREP: cleaning up c23cc2a6
(tcp://10.18.0.38:4567)
2017-05-31 15:53:20 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:20 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:53:20 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,530) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
})
2017-05-31 15:53:20 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:20 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE: sent
state msg: cc018bb6-463a-11e7-abec-4e72ee8449eb
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: cc018bb6-463a-11e7-abec-4e72ee8449eb from 0
(o-packetfence01-tdv.wctnet.org)
2017-05-31 15:53:20 140202693617408 [Note] WSREP: STATE EXCHANGE: got
state msg: cc018bb6-463a-11e7-abec-4e72ee8449eb from 1
(o-packetfence02-tdv.wctnet.org)
2017-05-31 15:53:20 140202693617408 [Warning] WSREP: Quorum: No node
with complete state:
Version : 4
Flags : 0x1
Protocols : 0 / 7 / 3
State : NON-PRIMARY
Desync count : 0
Prim state : JOINER
Prim UUID : c1ddf18e-463a-11e7-8d7c-63040f09c269
Prim seqno : 107
First seqno : -1
Last seqno : 6
Prim JOINED : 1
State UUID : cc018bb6-463a-11e7-abec-4e72ee8449eb
Group UUID : d53707fc-462e-11e7-9e94-2307d1d8c35a
Name : 'o-packetfence01-tdv.wctnet.org'
Incoming addr: '10.18.0.36:3306'
Version : 4
Flags : 0x2
Protocols : 0 / 7 / 3
State : NON-PRIMARY
Desync count : 1
Prim state : DONOR
Prim UUID : c1ddf18e-463a-11e7-8d7c-63040f09c269
Prim seqno : 107
First seqno : 1
Last seqno : 6
Prim JOINED : 1
State UUID : cc018bb6-463a-11e7-abec-4e72ee8449eb
Group UUID : d53707fc-462e-11e7-9e94-2307d1d8c35a
Name : 'o-packetfence02-tdv.wctnet.org'
Incoming addr: '10.18.0.37:3306'
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Full re-merge of
primary c1ddf18e-463a-11e7-8d7c-63040f09c269 found: 1 of 1.
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Quorum results:
version = 4,
component = PRIMARY,
conf_id = 107,
members = 1/2 (joined/total),
act_id = 6,
last_appl. = 0,
protocols = 0/7/3 (gcs/repl/appl),
group UUID = d53707fc-462e-11e7-9e94-2307d1d8c35a
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Flow-control interval:
[23, 23]
2017-05-31 15:53:20 140202693617408 [Note] WSREP: Restored state OPEN ->
DONOR/DESYNCED (6)
2017-05-31 15:53:20 140202996570880 [Note] WSREP: New cluster view:
global state: d53707fc-462e-11e7-9e94-2307d1d8c35a:6, view# 108:
Primary, number of nodes: 2, my index: 1, protocol version 3
2017-05-31 15:53:20 140202996570880 [Note] WSREP: REPL Protocols: 7 (3, 2)
2017-05-31 15:53:20 140202996570880 [Note] WSREP: Assign initial
position for certification: 6, protocol version: 3
2017-05-31 15:53:20 140202751923968 [Note] WSREP: Service thread queue
flushed.
2017-05-31 15:53:20 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:20 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2017-05-31 15:53:24 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') turning message relay requesting off
2017-05-31 15:53:27 140202702010112 [Note] WSREP: declaring 6bac5196 at
tcp://10.18.0.36:4567 stable
2017-05-31 15:53:27 140202702010112 [Note] WSREP: Node 6bac5196 state prim
2017-05-31 15:53:27 140202702010112 [Note] WSREP:
view(view_id(PRIM,6bac5196,531) memb {
6bac5196,0
d53696c2,0
} joined {
} left {
} partitioned {
})
2017-05-31 15:53:27 140202702010112 [Note] WSREP: save pc into disk
2017-05-31 15:53:27 140202702010112 [Note] WSREP: forgetting c23cc2a6
(tcp://10.18.0.38:4567)
2017-05-31 15:53:27 140202693617408 [Note] WSREP: New COMPONENT: primary
= yes, bootstrap = no, my_idx = 1, memb_num = 2
2017-05-31 15:53:27 140202693617408 [Note] WSREP: STATE EXCHANGE:
Waiting for state UUID.
2017-05-31 15:53:28 140202702010112 [Note] WSREP: (d53696c2,
'tcp://0.0.0.0:4567') connection established to c23cc2a6
tcp://10.18.0.38:4567
2017-05-31 15:53:28 140202702010112 [Warning] WSREP: discarding
established (time wait) c23cc2a6 (tcp://10.18.0.38:4567)
2017-05-31 15:53:30 140202702010112 [Note] WSREP: cleaning up c23cc2a6
(tcp://10.18.0.38:4567)
--
Peter Reilly
Wycliffe Bible Translators
***@wycliffe.org
Peter Reilly
Wycliffe Bible Translators
***@wycliffe.org