2022-04-23T14:54:00.183 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b
2022-04-23T14:54:00.227 INFO:teuthology.results:subset: '111/120000'
2022-04-23T14:54:00.228 INFO:teuthology.results:seed: '9320'
2022-04-23T20:30:16.368 INFO:root:teuthology version: 1.1.1.dev313+g1b11219b
2022-04-23T20:30:16.404 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-04-24T03:25:48.755 INFO:teuthology.results:Tests finished! gathering results...
2022-04-24T03:25:58.895 INFO:scrape:Found 96 jobs
2022-04-24T03:26:04.700 INFO:scrape:Found 4 distinct failure reasons
2022-04-24T03:26:04.701 INFO:scrape:Failure: Extra data: line 2 column 483 (char 483)
2022-04-24T03:26:04.701 INFO:scrape:8 jobs: ['6802502', '6802509', '6802463', '6802455', '6802525', '6802474', '6802436', '6802482']
2022-04-24T03:26:04.701 INFO:scrape:suites intersection: ['1-client', '2-upgrade', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'mds', 'mon', 'osd}', 'pg-warn', 'tasks/{0-octopus', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-24T03:26:04.701 INFO:scrape:suites union: ['1-client', '2-upgrade', '3-client-upgrade', '3-compat_client/pacific}}', '4-compat_client', '5-client-sanity}}', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{multimds/no', 'overrides/{multimds/yes', 'pg-warn', 'tasks/{0-octopus', 'upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap', 'upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-24T03:26:04.701 INFO:scrape:
2022-04-24T03:26:04.702 INFO:scrape:Dead: b'2022-04-24T03:05:29.576 DEBUG:teuthology.exit:Finished running handlers'
2022-04-24T03:26:04.702 INFO:scrape:1 jobs: ['6802531']
2022-04-24T03:26:04.702 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun']
2022-04-24T03:26:04.702 INFO:scrape:
2022-04-24T03:26:04.702 INFO:scrape:Failure: No module named 'nose'
2022-04-24T03:26:04.702 INFO:scrape:4 jobs: ['6802442', '6802492', '6802516', '6802468']
2022-04-24T03:26:04.702 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters']
2022-04-24T03:26:04.703 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/primary}', 'upgrade/secondary}']
2022-04-24T03:26:04.703 INFO:scrape:
2022-04-24T03:26:04.703 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi039.front.sepia.ceph.com: ['type=AVC msg=audit(1650737763.486:200): avc:  denied  { node_bind } for  pid=2090 comm="ping" saddr=172.21.15.39 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']
2022-04-24T03:26:04.703 INFO:scrape:7 jobs: ['6802470', '6802494', '6802491', '6802439', '6802515', '6802450', '6802475']
2022-04-24T03:26:04.703 INFO:scrape:suites intersection: []
2022-04-24T03:26:04.703 INFO:scrape:suites union: ['0-start', '1-ranks/1', '1-ranks/2', '1-tasks', '1-upgrade}}', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'centos_latest', 'conf/{client', 'mds', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'no-mds-cluster', 'osd}', 'overrides/{pg-warn', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'roles', 'syntax', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'tasks/{0-octopus', 'test_rbd_api', 'test_rbd_api}}', 'test_rbd_python}}', 'upgrade-sequence', 'upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap', 'upgrade/cephfs/nofs/{bluestore-bitmap', 'upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools', 'upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun', 'upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workload/{ec-rados-default']
2022-04-24T03:26:04.703 INFO:scrape:
2022-04-24T03:26:04.710 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/
failed:  19
dead:    1
running: 0
waiting: 0
queued:  0
passed:  76


Fail
=================================================================
[6802436]  upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:19:32
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802436/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802436/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7df71d1bc4ab47c9971632f29bf78030

    Extra data: line 2 column 555 (char 555)

[6802439]  upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:30:43
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802439/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802439/

    SELinux denials found on ubuntu@smithi082.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650726488.396:200): avc:  denied  { node_bind } for  pid=2058
    comm="ping" saddr=172.21.15.82 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802442]  upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary}
-----------------------------------------------------------------
time:   00:06:36
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802442/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802442/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c3f704a50fb4fbc80748f2af1243911

    No module named 'nose'

[6802450]  upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:29:08
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802450/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802450/

    SELinux denials found on ubuntu@smithi116.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650729058.344:200): avc:  denied  { node_bind } for  pid=2083
    comm="ping" saddr=172.21.15.116 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802455]  upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:13:32
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802455/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802455/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f7f6e985e185408aab161404b44bc7e7

    Extra data: line 2 column 475 (char 475)

[6802463]  upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:23:53
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802463/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802463/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a4df8ac612084b54b12e81fc9cbc4ac1

    Extra data: line 2 column 549 (char 549)

[6802468]  upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary}
-----------------------------------------------------------------
time:   00:06:26
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802468/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802468/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a8eabf14576d455db4406ddf3c1cad80

    No module named 'nose'

[6802470]  upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:32:21
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802470/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802470/

    SELinux denials found on ubuntu@smithi039.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650737763.486:200): avc:  denied  { node_bind } for  pid=2090
    comm="ping" saddr=172.21.15.39 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802474]  upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:13:41
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802474/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802474/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cc85abdeba4f482a84a1b97491c79291

    Extra data: line 2 column 478 (char 478)

[6802475]  upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
-----------------------------------------------------------------
time:   01:01:38
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802475/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802475/

    SELinux denials found on ubuntu@smithi116.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650738108.154:200): avc:  denied  { node_bind } for  pid=2012
    comm="ping" saddr=172.21.15.116 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802482]  upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:23:24
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802482/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802482/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40847e65b682424c94806ab7213d03d2

    Extra data: line 2 column 562 (char 562)

[6802491]  upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
-----------------------------------------------------------------
time:   01:01:23
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802491/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802491/

    SELinux denials found on ubuntu@smithi082.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650738971.492:200): avc:  denied  { node_bind } for  pid=2076
    comm="ping" saddr=172.21.15.82 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802492]  upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary}
-----------------------------------------------------------------
time:   00:06:32
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802492/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802492/
sentry: https://sentry.ceph.com/organizations/ceph/?query=30639ab902844ca48615b08853667094

    No module named 'nose'

[6802494]  upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}}
-----------------------------------------------------------------
time:   00:09:07
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802494/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802494/

    SELinux denials found on ubuntu@smithi141.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650739569.520:202): avc:  denied  { node_bind } for  pid=2040
    comm="ping" saddr=172.21.15.141 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802502]  upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:13:42
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802502/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802502/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0b8bba886afa490a986bfd9b3193284d

    Extra data: line 2 column 483 (char 483)

[6802509]  upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:22:24
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802509/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802509/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a423f1bccc74255b36074b7eda8f63a

    Extra data: line 2 column 555 (char 555)

[6802515]  upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   01:16:16
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802515/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802515/

    SELinux denials found on ubuntu@smithi114.front.sepia.ceph.com: ['type=AVC
    msg=audit(1650742350.888:200): avc:  denied  { node_bind } for  pid=2037
    comm="ping" saddr=172.21.15.114 scontext=system_u:system_r:ping_t:s0
    tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

[6802516]  upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary}
-----------------------------------------------------------------
time:   00:06:19
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802516/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802516/
sentry: https://sentry.ceph.com/organizations/ceph/?query=92641318ecad4bdf8929fdcdf68976c9

    No module named 'nose'

[6802525]  upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:13:37
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802525/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802525/
sentry: https://sentry.ceph.com/organizations/ceph/?query=945ada790d664beb8c92c22f42f27737

    Extra data: line 2 column 480 (char 480)



Dead
=================================================================
[6802531]  upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802531/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802531/

    hit max job timeout



Pass
=================================================================
[6802437] upgrade/octopus-x/stress-split/{0-distro/rhel_8.5_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:07:40
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802437/

[6802438] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:07:47
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802438/

[6802440] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:01:30
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802440/

[6802441] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:16:43
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802441/

[6802443] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:25:00
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802443/

[6802444] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04}
time:   03:50:54
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802444/

[6802445] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04}
time:   05:02:30
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802445/

[6802446] upgrade/pacific-x/stress-split/{0-distro/rhel_8.5_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:42:00
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802446/

[6802447] upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}}
time:   00:08:46
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802447/

[6802448] upgrade/octopus-x/stress-split/{0-distro/rhel_8.5_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:00:28
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802448/

[6802449] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:02:15
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802449/

[6802451] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:19:35
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802451/

[6802452] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:20:30
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802452/

[6802453] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:06:04
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802453/

[6802454] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04}
time:   01:39:50
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802454/

[6802456] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04}
time:   02:41:32
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802456/

[6802457] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:08:10
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802457/

[6802458] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:19:26
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802458/

[6802459] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:32:33
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802459/

[6802460] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:03:51
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802460/

[6802461] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:41:35
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802461/

[6802462] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:08:25
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802462/

[6802464] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:55:52
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802464/

[6802465] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:01:48
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802465/

[6802466] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:24:52
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802466/

[6802467] upgrade/pacific-x/parallel/{0-random-distro$/{rhel_8.5_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:22:21
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802467/

[6802469] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04}
time:   02:17:12
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802469/

[6802471] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04}
time:   05:07:04
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802471/

[6802472] upgrade/pacific-x/stress-split/{0-distro/rhel_8.5_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:25:57
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802472/

[6802473] upgrade/octopus-x/stress-split/{0-distro/rhel_8.5_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:36:30
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802473/

[6802476] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:05:42
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802476/

[6802477] upgrade/pacific-x/stress-split/{0-distro/rhel_8.5_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:45:42
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802477/

[6802478] upgrade/octopus-x/stress-split/{0-distro/rhel_8.5_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:44:59
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802478/

[6802479] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:29:16
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802479/

[6802480] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04}
time:   03:12:28
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802480/

[6802481] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04}
time:   02:34:12
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802481/

[6802483] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:27:54
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802483/

[6802484] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:03:32
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802484/

[6802485] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:23:54
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802485/

[6802486] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:31:22
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802486/

[6802487] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:08:59
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802487/

[6802488] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:13:55
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802488/

[6802489] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:06:50
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802489/

[6802490] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:25:37
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802490/

[6802493] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:17:23
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802493/

[6802495] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04}
time:   03:40:21
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802495/

[6802496] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04}
time:   04:18:42
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802496/

[6802497] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:01:42
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802497/

[6802498] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:57
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802498/

[6802499] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:49:18
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802499/

[6802500] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:59:45
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802500/

[6802501] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:05:36
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802501/

[6802503] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04}
time:   02:18:56
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802503/

[6802504] upgrade/pacific-x/stress-split/{0-distro/rhel_8.5_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:28:39
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802504/

[6802505] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04}
time:   02:32:52
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802505/

[6802506] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:31:01
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802506/

[6802507] upgrade/octopus-x/stress-split/{0-distro/rhel_8.5_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:09:17
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802507/

[6802508] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:03:41
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802508/

[6802510] upgrade/pacific-x/stress-split/{0-distro/rhel_8.5_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:01:47
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802510/

[6802511] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:07:54
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802511/

[6802512] upgrade/octopus-x/stress-split/{0-distro/rhel_8.5_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:06:00
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802512/

[6802513] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:35:28
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802513/

[6802514] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:02:17
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802514/

[6802517] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04}
time:   01:40:55
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802517/

[6802518] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:25:57
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802518/

[6802519] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04}
time:   04:21:18
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802519/

[6802520] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:17:10
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802520/

[6802521] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:18:17
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802521/

[6802522] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:32:22
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802522/

[6802523] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:01:59
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802523/

[6802524] upgrade/octopus-x/parallel/{0-distro/rhel_8.5_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:06:24
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802524/

[6802526] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:54:36
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802526/

[6802527] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:01:46
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802527/

[6802528] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04}
time:   03:26:44
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802528/

[6802529] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:26
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802529/

[6802530] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04}
time:   02:47:07
info:   http://pulpito.ceph.com/yuriw-2022-04-23_14:46:12-upgrade-master-distro-default-smithi/6802530/