HA & Cluster

Sentinel failover, cluster failover, replica sync, reshard, mixed deployment, network partition · Latest 10 runs per sub-item

sentinel sync Latest: running
Status Summary Duration Version Time Run
syncrunning Running... - engula-latest 2026-08-09 02:01:30 #66498
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-09 01:53:38 #66494
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-09 01:53:38 #66493
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-09 01:45:36 #66489
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 16s engula-latest 2026-08-09 01:45:36 #66488
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-09 01:37:43 #66483
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-09 01:37:43 #66482
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 17s engula-latest 2026-08-09 01:29:47 #66479
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 17s engula-latest 2026-08-09 01:29:47 #66478
check_circlepass Sentinel failover: 6.5s, error_duration=0.0s, 65 errors, no data loss 15s engula-latest 2026-08-09 01:21:56 #66475
cluster check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Cluster failover: 8.0s, 3 errors, no data loss 22s engula-latest 2026-08-09 01:53:38 #66494
check_circlepass Cluster failover: 8.0s, 3 errors, no data loss 22s engula-latest 2026-08-09 01:53:38 #66493
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 23s engula-latest 2026-08-09 01:45:36 #66489
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 23s engula-latest 2026-08-09 01:45:36 #66488
check_circlepass Cluster failover: 8.0s, 3 errors, no data loss 22s engula-latest 2026-08-09 01:37:43 #66483
check_circlepass Cluster failover: 8.0s, 3 errors, no data loss 22s engula-latest 2026-08-09 01:37:43 #66482
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 23s engula-latest 2026-08-09 01:29:47 #66479
check_circlepass Cluster failover: 10.0s, 4 errors, no data loss 23s engula-latest 2026-08-09 01:29:47 #66478
check_circlepass Cluster failover: 6.0s, 2 errors, no data loss 30s engula-latest 2026-08-09 01:21:56 #66475
check_circlepass Cluster failover: 6.0s, 2 errors, no data loss 30s engula-latest 2026-08-09 01:21:56 #66474
replica-sync check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-09 01:53:38 #66494
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-09 01:53:38 #66493
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 8s engula-latest 2026-08-09 01:45:36 #66489
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 8s engula-latest 2026-08-09 01:45:36 #66488
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-09 01:37:43 #66483
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 6s engula-latest 2026-08-09 01:37:43 #66482
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-09 01:29:47 #66479
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 7s engula-latest 2026-08-09 01:29:47 #66478
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 8s engula-latest 2026-08-09 01:21:56 #66475
check_circlepass Replica sync: 5 type tests passed, 10000 bulk keys verified, offset_diff=0 8s engula-latest 2026-08-09 01:21:56 #66474
reshard check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Reshard: duration=12.9s, data_loss=0, error_rate=0.00% 1m24s engula-latest 2026-08-09 01:53:38 #66494
check_circlepass Reshard: duration=12.9s, data_loss=0, error_rate=0.00% 1m24s engula-latest 2026-08-09 01:53:38 #66493
check_circlepass Reshard: duration=12.3s, data_loss=0, error_rate=0.00% 1m28s engula-latest 2026-08-09 01:45:36 #66489
check_circlepass Reshard: duration=12.3s, data_loss=0, error_rate=0.00% 1m28s engula-latest 2026-08-09 01:45:36 #66488
check_circlepass Reshard: duration=11.3s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-09 01:37:43 #66483
check_circlepass Reshard: duration=11.3s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-09 01:37:43 #66482
check_circlepass Reshard: duration=11.7s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-09 01:29:47 #66479
check_circlepass Reshard: duration=11.7s, data_loss=0, error_rate=0.00% 1m22s engula-latest 2026-08-09 01:29:47 #66478
check_circlepass Reshard: duration=11.3s, data_loss=0, error_rate=0.00% 1m23s engula-latest 2026-08-09 01:21:56 #66475
check_circlepass Reshard: duration=11.3s, data_loss=0, error_rate=0.00% 1m23s engula-latest 2026-08-09 01:21:56 #66474
mixed check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=10.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 44s engula-latest 2026-08-09 01:53:38 #66494
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=10.0s loss=0, Scenario B (Engula primaries) failover=6.0s loss=0 44s engula-latest 2026-08-09 01:53:38 #66493
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=10.0s loss=0, Scenario B (Engula primaries) failover=10.0s loss=0 47s engula-latest 2026-08-09 01:45:36 #66489
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=10.0s loss=0, Scenario B (Engula primaries) failover=10.0s loss=0 47s engula-latest 2026-08-09 01:45:36 #66488
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=2, Scenario B (Engula primaries) failover=10.0s loss=0 48s engula-latest 2026-08-09 01:37:43 #66483
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=6.0s loss=2, Scenario B (Engula primaries) failover=10.0s loss=0 48s engula-latest 2026-08-09 01:37:43 #66482
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=8.0s loss=0, Scenario B (Engula primaries) failover=8.0s loss=1 46s engula-latest 2026-08-09 01:29:47 #66479
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=8.0s loss=0, Scenario B (Engula primaries) failover=8.0s loss=1 46s engula-latest 2026-08-09 01:29:47 #66478
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=8.0s loss=0, Scenario B (Engula primaries) failover=2.0s loss=0 37s engula-latest 2026-08-09 01:21:56 #66475
check_circlepass Mixed cluster: Scenario A (Redis primaries) failover=8.0s loss=0, Scenario B (Engula primaries) failover=2.0s loss=0 37s engula-latest 2026-08-09 01:21:56 #66474
network-partition check_circle Latest: pass
Status Summary Duration Version Time Run
check_circlepass Network partition recovered: detection 8445.0ms, failover 10260.0ms, recovery 404.0ms, no data loss 43s engula-latest 2026-06-29 20:32:58 #30164