2022-02-11T20:15:42.736 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-11T20:15:42.738 INFO:teuthology.results:subset: '111/120000' 2022-02-11T20:15:42.738 INFO:teuthology.results:seed: '1542' 2022-02-11T23:02:17.173 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-11T23:02:17.206 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-12T04:00:41.017 INFO:teuthology.results:Tests finished! gathering results... 2022-02-12T04:00:51.891 INFO:scrape:Found 87 jobs 2022-02-12T04:00:52.124 WARNING:scrape:Not-understood crash indication 2022-02-11T21:17:58.317 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.125 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.143 WARNING:scrape:Not-understood crash indication 2022-02-11T21:17:58.317 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.144 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.163 WARNING:scrape:Not-understood crash indication 2022-02-11T21:17:58.317 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.164 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.184 WARNING:scrape:Not-understood crash indication 2022-02-11T21:17:58.317 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.186 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.322 WARNING:scrape:Not-understood crash indication 2022-02-11T21:57:30.475 INFO:tasks.rgw.c2.client.0.smithi118.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.323 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.345 WARNING:scrape:Not-understood crash indication 2022-02-11T21:57:30.475 INFO:tasks.rgw.c2.client.0.smithi118.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.346 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.740 WARNING:scrape:Not-understood crash indication 2022-02-11T23:00:45.237 INFO:tasks.rgw.c2.client.0.smithi190.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.741 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.763 WARNING:scrape:Not-understood crash indication 2022-02-11T23:00:45.237 INFO:tasks.rgw.c2.client.0.smithi190.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.764 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.940 WARNING:scrape:Not-understood crash indication 2022-02-11T20:50:33.931 INFO:tasks.rgw.c2.client.0.smithi085.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.941 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.960 WARNING:scrape:Not-understood crash indication 2022-02-11T20:50:33.931 INFO:tasks.rgw.c2.client.0.smithi085.stderr:daemon-helper: command crashed with signal 11 2022-02-12T04:00:52.961 WARNING:scrape:Not-understood crash indication 2022-02-12T04:00:52.963 INFO:scrape:Found 4 distinct failure reasons 2022-02-12T04:00:52.963 INFO:scrape:Failure: Command failed on smithi155 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-02-12T04:00:52.964 INFO:scrape:8 jobs: ['6677318', '6677349', '6677328', '6677306', '6677275', '6677298', '6677341', '6677284'] 2022-02-12T04:00:52.964 INFO:scrape:suites intersection: ['1-ceph-install/octopus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-02-12T04:00:52.965 INFO:scrape:suites union: ['1-ceph-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-02-12T04:00:52.965 INFO:scrape: 2022-02-12T04:00:52.966 INFO:scrape:Failure: rgw multisite test failures 2022-02-12T04:00:52.966 INFO:scrape:4 jobs: ['6677294', '6677316', '6677338', '6677272'] 2022-02-12T04:00:52.967 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters'] 2022-02-12T04:00:52.967 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/primary}', 'upgrade/secondary}'] 2022-02-12T04:00:52.968 INFO:scrape: 2022-02-12T04:00:52.968 INFO:scrape:Failure: Command failed on smithi155 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7da25c38-8b81-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_4' 2022-02-12T04:00:52.969 INFO:scrape:1 jobs: ['6677308'] 2022-02-12T04:00:52.969 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/v16.2.4', 'upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-12T04:00:52.970 INFO:scrape: 2022-02-12T04:00:52.970 INFO:scrape:Dead: b'2022-02-12T03:47:14.309 DEBUG:teuthology.exit:Finished running handlers' 2022-02-12T04:00:52.971 INFO:scrape:1 jobs: ['6677305'] 2022-02-12T04:00:52.971 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/rbd_api', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04'] 2022-02-12T04:00:52.971 INFO:scrape: 2022-02-12T04:00:52.978 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/ failed: 13 dead: 1 running: 0 waiting: 0 queued: 0 passed: 73 Fail ================================================================= [6677272] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:07:06 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677272/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677272/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1cda96e8a2844590bdfcffb8ccc4c64b rgw multisite test failures [6677275] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:42:14 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677275/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7193e86970274f4da313ae5678046c4e Command failed on smithi142 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677284] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:52:41 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677284/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f209895cd8140649a07f25599710538 Command failed on smithi176 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677294] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:07:42 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677294/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677294/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66087e0b631848229413b98537ad0342 rgw multisite test failures [6677298] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:20:33 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677298/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677298/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fce1b1eb28dd4dbea0689d21c9d0f246 Command failed on smithi170 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677306] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:44:41 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677306/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677306/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71ddfdc022c24345ad07ddc8db069102 Command failed on smithi201 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677308] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677308/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677308/ sentry: https://sentry.ceph.com/organizations/ceph/?query=373e8b046c1743ccbba345fe7edf8c4a Command failed on smithi155 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7da25c38-8b81-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi155:vg_nvme/lv_4' [6677316] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:06:34 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677316/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b02af75ab144c9a967a6f517699a0bc rgw multisite test failures [6677318] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:30:34 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677318/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677318/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d3e07d5bc07c46daa19ce89ab432e1fa Command failed on smithi155 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677328] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:44:10 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677328/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677328/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72a8f7222a4c4134b5918882100b6e25 Command failed on smithi106 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677338] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:07:37 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677338/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b27a507ab054dafaa65b5796ca503bc rgw multisite test failures [6677341] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:42:40 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677341/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677341/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59cab67d9b1d4a95a60a44d7a4d3bcae Command failed on smithi196 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6677349] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:46:24 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677349/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677349/ sentry: https://sentry.ceph.com/organizations/ceph/?query=beb8a3224f844f0187813b287601d733 Command failed on smithi186 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [6677305] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677305/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677305/ hit max job timeout Pass ================================================================= [6677264] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:21:35 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677264/ [6677265] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:52 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677265/ [6677266] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:13:25 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677266/ [6677267] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:09:11 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677267/ [6677268] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677268/ [6677269] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:10:23 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677269/ [6677270] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 00:59:50 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677270/ [6677271] upgrade/pacific-x/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:29:23 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677271/ [6677273] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 01:40:46 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677273/ [6677274] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677274/ [6677276] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:15:59 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677276/ [6677277] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:12:08 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677277/ [6677278] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:00:22 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677278/ [6677279] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:17:53 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677279/ [6677280] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:33 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677280/ [6677281] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:56:01 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677281/ [6677282] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:50:50 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677282/ [6677283] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:24:21 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677283/ [6677285] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:38 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677285/ [6677286] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:39:58 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677286/ [6677287] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:18:47 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677287/ [6677288] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:12:11 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677288/ [6677289] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:05 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677289/ [6677290] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:01:24 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677290/ [6677291] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:05:40 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677291/ [6677292] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677292/ [6677293] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 00:59:48 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677293/ [6677295] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:13:53 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677295/ [6677296] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:29:31 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677296/ [6677297] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:22 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677297/ [6677299] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 00:59:58 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677299/ [6677300] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:15:18 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677300/ [6677301] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:15:39 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677301/ [6677302] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:13 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677302/ [6677303] upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:07:30 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677303/ [6677304] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 01:42:34 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677304/ [6677307] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:06:23 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677307/ [6677309] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:26 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677309/ [6677310] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 01:54:21 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677310/ [6677311] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:51 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677311/ [6677312] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:01:23 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677312/ [6677313] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:00:12 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677313/ [6677314] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677314/ [6677315] upgrade/pacific-x/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:30:19 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677315/ [6677317] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 02:18:22 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677317/ [6677319] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:18:07 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677319/ [6677320] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:46:17 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677320/ [6677321] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:05 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677321/ [6677322] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 00:59:21 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677322/ [6677323] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:42:00 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677323/ [6677324] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:21:37 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677324/ [6677325] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:19:08 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677325/ [6677326] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:18:40 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677326/ [6677327] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 03:50:32 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677327/ [6677329] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:57:56 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677329/ [6677330] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:24 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677330/ [6677331] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:05:55 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677331/ [6677332] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:11 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677332/ [6677333] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:10 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677333/ [6677334] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:22:14 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677334/ [6677335] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:10:40 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677335/ [6677336] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 00:59:12 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677336/ [6677337] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:22:00 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677337/ [6677339] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:13:53 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677339/ [6677340] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 03:48:56 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677340/ [6677342] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 00:59:53 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677342/ [6677343] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:40 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677343/ [6677344] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:59:04 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677344/ [6677345] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:41:14 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677345/ [6677346] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:19 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677346/ [6677347] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 02:11:03 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677347/ [6677348] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 01:58:49 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677348/ [6677350] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2022-02-11_19:39:19-upgrade-wip-yuriw-quincy-RC-2.11.22-distro-default-smithi/6677350/