2022-01-22T17:46:29.227 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-22T17:46:29.231 INFO:teuthology.results:subset: '111/120000' 2022-01-22T17:46:29.231 INFO:teuthology.results:seed: '5186' 2022-01-22T21:13:54.034 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-22T21:13:54.068 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-23T01:49:16.176 INFO:teuthology.results:Tests finished! gathering results... 2022-01-23T01:49:27.393 INFO:scrape:Found 99 jobs 2022-01-23T01:49:27.555 WARNING:scrape:Not-understood crash indication 2022-01-22T19:02:50.024 INFO:tasks.rgw.c2.client.0.smithi074.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:27.556 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:27.576 WARNING:scrape:Not-understood crash indication 2022-01-22T19:02:50.024 INFO:tasks.rgw.c2.client.0.smithi074.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:27.577 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:27.596 WARNING:scrape:Not-understood crash indication 2022-01-22T19:02:50.024 INFO:tasks.rgw.c2.client.0.smithi074.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:27.597 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:27.616 WARNING:scrape:Not-understood crash indication 2022-01-22T19:02:50.024 INFO:tasks.rgw.c2.client.0.smithi074.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:27.617 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:27.738 WARNING:scrape:Not-understood crash indication 2022-01-22T20:58:03.179 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:27.739 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:27.762 WARNING:scrape:Not-understood crash indication 2022-01-22T20:58:03.179 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:27.763 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:28.034 WARNING:scrape:Not-understood crash indication 2022-01-22T18:22:00.806 INFO:tasks.rgw.c2.client.0.smithi173.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:28.035 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:28.055 WARNING:scrape:Not-understood crash indication 2022-01-22T18:22:00.806 INFO:tasks.rgw.c2.client.0.smithi173.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:28.056 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:28.197 WARNING:scrape:Not-understood crash indication 2022-01-22T20:12:16.670 INFO:tasks.rgw.c2.client.0.smithi132.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:28.198 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:28.217 WARNING:scrape:Not-understood crash indication 2022-01-22T20:12:16.670 INFO:tasks.rgw.c2.client.0.smithi132.stderr:daemon-helper: command crashed with signal 11 2022-01-23T01:49:28.218 WARNING:scrape:Not-understood crash indication 2022-01-23T01:49:29.016 INFO:scrape:Found 3 distinct failure reasons 2022-01-23T01:49:29.017 INFO:scrape:Failure: Command failed on smithi198 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-01-23T01:49:29.017 INFO:scrape:8 jobs: ['6635005', '6634905', '6634854', '6634883', '6634984', '6634832', '6634956', '6634934'] 2022-01-23T01:49:29.018 INFO:scrape:suites intersection: ['1-ceph-install/octopus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-23T01:49:29.019 INFO:scrape:suites union: ['1-ceph-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-23T01:49:29.019 INFO:scrape: 2022-01-23T01:49:29.020 INFO:scrape:Failure: rgw multisite test failures 2022-01-23T01:49:29.020 INFO:scrape:4 jobs: ['6634877', '6634976', '6634826', '6634926'] 2022-01-23T01:49:29.020 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters'] 2022-01-23T01:49:29.021 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/primary}', 'upgrade/secondary}'] 2022-01-23T01:49:29.021 INFO:scrape: 2022-01-23T01:49:29.022 INFO:scrape:Dead: b'2022-01-23T00:48:34.577 DEBUG:teuthology.exit:Finished running handlers' 2022-01-23T01:49:29.022 INFO:scrape:1 jobs: ['6634863'] 2022-01-23T01:49:29.023 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/v16.2.4', 'upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-23T01:49:29.023 INFO:scrape: 2022-01-23T01:49:29.030 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/ failed: 12 dead: 1 running: 0 waiting: 0 queued: 0 passed: 86 Fail ================================================================= [6634826] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:06:37 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634826/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634826/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0f961106f624ae7b10f7222b30e1ec0 rgw multisite test failures [6634832] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:51:40 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634832/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634832/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85dc8565453f4f4d9ae63da6ac3f7766 Command failed on smithi197 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6634854] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 02:00:43 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634854/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634854/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0cd78affdd1427fbe328140a050f9ec Command failed on smithi145 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6634877] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:07:04 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634877/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634877/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1bee96c95a5e4da7a9cc98546962c128 rgw multisite test failures [6634883] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:45:25 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634883/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634883/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ae994416a114c8dbaddc819d0647d0d Command failed on smithi159 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6634905] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:50:39 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634905/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634905/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b30a967adabe41069bb73e6327298b86 Command failed on smithi166 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6634926] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:06:32 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634926/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634926/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dda38d4717f3415cb92656d168c116f0 rgw multisite test failures [6634934] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:39:00 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634934/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634934/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae430eaf02044667b8345cc57661ea2c Command failed on smithi170 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6634956] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:52:24 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634956/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634956/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55f9c8a922aa49aaa77bd8402c47473e Command failed on smithi195 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6634976] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:08:14 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634976/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634976/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d3713f5eaed843d5b9436f65645a85a3 rgw multisite test failures [6634984] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:48:24 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634984/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634984/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e241947abb248159d342b69db6ef6c0 Command failed on smithi167 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6635005] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 02:10:14 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635005/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635005/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3019b2e5cc2742f6b9d755745c91d914 Command failed on smithi198 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [6634863] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634863/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634863/ hit max job timeout Pass ================================================================= [6634818] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:14:33 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634818/ [6634820] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:18:11 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634820/ [6634822] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:26:01 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634822/ [6634824] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:48 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634824/ [6634828] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:21:03 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634828/ [6634830] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:34:30 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634830/ [6634834] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:29 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634834/ [6634836] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:06:41 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634836/ [6634838] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:18:44 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634838/ [6634840] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:19:03 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634840/ [6634842] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:37 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634842/ [6634844] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:20 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634844/ [6634846] upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:11:07 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634846/ [6634848] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:55:44 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634848/ [6634850] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:56:14 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634850/ [6634852] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 01:40:34 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634852/ [6634856] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:37 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634856/ [6634858] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:12:57 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634858/ [6634861] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:19:52 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634861/ [6634865] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:50 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634865/ [6634867] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:57 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634867/ [6634869] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:54:34 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634869/ [6634871] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:45:25 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634871/ [6634873] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:39 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634873/ [6634875] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:18:47 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634875/ [6634879] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:15:22 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634879/ [6634881] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 02:10:58 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634881/ [6634885] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:44 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634885/ [6634887] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:00 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634887/ [6634889] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:12 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634889/ [6634891] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:02:34 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634891/ [6634893] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:20 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634893/ [6634895] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:03:14 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634895/ [6634897] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:23:31 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634897/ [6634899] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:21:57 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634899/ [6634901] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:22:22 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634901/ [6634903] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:01:55 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634903/ [6634907] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:19:14 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634907/ [6634909] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:18:41 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634909/ [6634912] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:22:42 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634912/ [6634914] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:50 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634914/ [6634916] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:18 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634916/ [6634918] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:39 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634918/ [6634920] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:03:15 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634920/ [6634922] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:05:20 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634922/ [6634924] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:28 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634924/ [6634928] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:25:31 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634928/ [6634930] upgrade/pacific-x/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:31:00 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634930/ [6634932] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 03:29:10 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634932/ [6634936] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:34 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634936/ [6634938] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:04:16 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634938/ [6634940] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:05:31 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634940/ [6634942] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:48 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634942/ [6634944] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:18 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634944/ [6634946] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:28 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634946/ [6634948] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:46:08 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634948/ [6634950] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:48:46 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634950/ [6634952] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 02:15:06 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634952/ [6634954] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:54 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634954/ [6634958] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:24 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634958/ [6634960] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:13:53 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634960/ [6634962] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:08:36 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634962/ [6634964] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:26 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634964/ [6634966] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:59 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634966/ [6634968] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634968/ [6634970] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:04:40 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634970/ [6634972] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:02:32 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634972/ [6634974] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:48 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634974/ [6634978] upgrade/pacific-x/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:31:32 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634978/ [6634980] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 01:42:08 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634980/ [6634982] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:18 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634982/ [6634986] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:33 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634986/ [6634988] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:12:56 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634988/ [6634990] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:17:56 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634990/ [6634992] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:03:13 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634992/ [6634995] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:20:15 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634995/ [6634997] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:31 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634997/ [6634999] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:05:16 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6634999/ [6635001] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:58:39 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635001/ [6635003] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:34:18 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635003/ [6635007] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:25 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635007/ [6635009] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:44 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635009/ [6635011] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:37:44 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635011/ [6635013] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:17:08 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635013/ [6635015] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:43 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635015/ [6635017] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:33 info: http://pulpito.ceph.com/yuriw-2022-01-22_17:45:07-upgrade-wip-yuriw-quincy-1.22.22-distro-default-smithi/6635017/