HA & Cluster

Sentinel failover, cluster failover, replica sync, reshard, mixed deployment, network partition · Latest 10 runs per sub-item

sentinel sync Latest: running
Status Summary Duration Version Time Run
syncrunning Running... - engula-latest 2026-08-29 04:25:41 #84082
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-29 04:17:55 #84078
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-29 04:17:55 #84076
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-29 04:09:39 #84072
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-29 04:09:39 #84071
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 17s engula-latest 2026-08-29 04:01:39 #84068
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 17s engula-latest 2026-08-29 04:01:39 #84067
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-29 03:53:48 #84063
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-29 03:53:48 #84062
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-29 03:45:53 #84058
cluster check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Cluster failover: 8.0s, 3 errors, no data loss 22s engula-latest 2026-08-29 04:17:55 #84078
check_circlepass Cluster failover: 8.0s, 3 errors, no data loss 22s engula-latest 2026-08-29 04:17:55 #84076
check_circlepass Cluster failover: 6.0s, 2 errors, no data loss 30s engula-latest 2026-08-29 04:09:39 #84072
check_circlepass Cluster failover: 6.0s, 2 errors, no data loss 30s engula-latest 2026-08-29 04:09:39 #84071
check_circlepass Cluster failover: 6.0s, 2 errors, no data loss 30s engula-latest 2026-08-29 04:01:39 #84068
check_circlepass Cluster failover: 6.0s, 2 errors, no data loss 30s engula-latest 2026-08-29 04:01:39 #84067
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 24s engula-latest 2026-08-29 03:53:48 #84063
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 24s engula-latest 2026-08-29 03:53:48 #84062
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 24s engula-latest 2026-08-29 03:45:53 #84058
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 24s engula-latest 2026-08-29 03:45:53 #84057
replica-sync check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-29 04:17:55 #84078
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-29 04:17:55 #84076
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-29 04:09:39 #84072
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-29 04:09:39 #84071
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-29 04:01:39 #84068
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-29 04:01:39 #84067
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-29 03:53:48 #84063
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-29 03:53:48 #84062
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-29 03:45:53 #84058
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-29 03:45:53 #84057
reshard check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Reshard: duration=11.1s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-29 04:17:55 #84078
check_circlepass Reshard: duration=11.1s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-29 04:17:55 #84076
check_circlepass Reshard: duration=15.2s, data_loss=0, error_rate=0.00% 1m41s engula-latest 2026-08-29 04:09:39 #84072
check_circlepass Reshard: duration=15.2s, data_loss=0, error_rate=0.00% 1m41s engula-latest 2026-08-29 04:09:39 #84071
check_circlepass Reshard: duration=12.2s, data_loss=0, error_rate=0.00% 1m28s engula-latest 2026-08-29 04:01:39 #84068
check_circlepass Reshard: duration=12.2s, data_loss=0, error_rate=0.00% 1m28s engula-latest 2026-08-29 04:01:39 #84067
check_circlepass Reshard: duration=11.9s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-29 03:53:48 #84063
check_circlepass Reshard: duration=11.9s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-29 03:53:48 #84062
check_circlepass Reshard: duration=11.5s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-29 03:45:53 #84058
check_circlepass Reshard: duration=11.5s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-29 03:45:53 #84057
mixed check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 40s engula-latest 2026-08-29 04:17:55 #84078
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 40s engula-latest 2026-08-29 04:17:55 #84076
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=10.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 44s engula-latest 2026-08-29 04:09:39 #84072
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=10.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 44s engula-latest 2026-08-29 04:09:39 #84071
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 39s engula-latest 2026-08-29 04:01:39 #84068
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 39s engula-latest 2026-08-29 04:01:39 #84067
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=0, Scenario B (Engula primaries) failover=10.0s loss=0 43s engula-latest 2026-08-29 03:53:48 #84063
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=0, Scenario B (Engula primaries) failover=10.0s loss=0 43s engula-latest 2026-08-29 03:53:48 #84062
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=2, Scenario B (Engula primaries) failover=8.0s loss=0 47s engula-latest 2026-08-29 03:45:53 #84058
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=2, Scenario B (Engula primaries) failover=8.0s loss=0 47s engula-latest 2026-08-29 03:45:53 #84057
network-partition check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Network partition recovered: detection 8445.0ms, failover 10260.0ms, recovery 404.0ms, no data loss 43s engula-latest 2026-06-29 20:32:58 #30164