2022-03-11T14:22:38.280 INFO:root:teuthology version: 1.1.0-ff5db916 2022-03-11T14:22:38.281 INFO:teuthology.results:subset: '4/10' 2022-03-11T14:22:38.282 INFO:teuthology.results:seed: '2324' 2022-03-11T14:57:18.737 INFO:root:teuthology version: 1.1.0-ff5db916 2022-03-11T14:57:18.742 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-11T21:35:47.802 INFO:teuthology.results:Tests finished! gathering results... 2022-03-11T21:35:50.833 INFO:scrape:Found 32 jobs 2022-03-11T21:35:50.951 WARNING:scrape:Not-understood crash indication 2022-03-11T15:12:05.914 INFO:tasks.rgw.c2.client.0.smithi157.stderr:daemon-helper: command crashed with signal 11 2022-03-11T21:35:50.952 WARNING:scrape:Not-understood crash indication 2022-03-11T21:35:50.969 WARNING:scrape:Not-understood crash indication 2022-03-11T15:12:05.914 INFO:tasks.rgw.c2.client.0.smithi157.stderr:daemon-helper: command crashed with signal 11 2022-03-11T21:35:50.970 WARNING:scrape:Not-understood crash indication 2022-03-11T21:35:50.988 WARNING:scrape:Not-understood crash indication 2022-03-11T15:12:05.914 INFO:tasks.rgw.c2.client.0.smithi157.stderr:daemon-helper: command crashed with signal 11 2022-03-11T21:35:50.989 WARNING:scrape:Not-understood crash indication 2022-03-11T21:35:51.161 WARNING:scrape:Not-understood crash indication 2022-03-11T14:57:42.674 INFO:tasks.rgw.c2.client.0.smithi133.stderr:daemon-helper: command crashed with signal 11 2022-03-11T21:35:51.162 WARNING:scrape:Not-understood crash indication 2022-03-11T21:35:51.199 INFO:scrape:Found 3 distinct failure reasons 2022-03-11T21:35:51.200 INFO:scrape:Failure: rgw multisite test failures 2022-03-11T21:35:51.200 INFO:scrape:2 jobs: ['6732037', '6732021'] 2022-03-11T21:35:51.200 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade:octopus-x/rgw-multisite/{clusters'] 2022-03-11T21:35:51.201 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/primary}', 'upgrade/secondary}', 'upgrade:octopus-x/rgw-multisite/{clusters'] 2022-03-11T21:35:51.201 INFO:scrape: 2022-03-11T21:35:51.202 INFO:scrape:Failure: Command failed on smithi155 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-03-11T21:35:51.202 INFO:scrape:4 jobs: ['6732031', '6732040', '6732024', '6732047'] 2022-03-11T21:35:51.202 INFO:scrape:suites intersection: ['1-ceph-install/octopus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-03-11T21:35:51.203 INFO:scrape:suites union: ['1-ceph-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-03-11T21:35:51.203 INFO:scrape: 2022-03-11T21:35:51.204 INFO:scrape:Dead: b'2022-03-11T21:15:22.416 DEBUG:teuthology.exit:Finished running handlers' 2022-03-11T21:35:51.204 INFO:scrape:1 jobs: ['6732038'] 2022-03-11T21:35:51.205 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04'] 2022-03-11T21:35:51.205 INFO:scrape: 2022-03-11T21:35:51.207 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/ failed: 6 dead: 1 running: 0 waiting: 0 queued: 0 passed: 25 Fail ================================================================= [6732021] upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:07:19 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732021/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732021/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8876746f79e04eb7864813a990115989 rgw multisite test failures [6732024] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:48:54 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732024/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732024/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7009094e635d4f9ab3be8b120132b8b1 Command failed on smithi178 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6732031] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:40:41 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732031/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732031/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f66bb2580df47dd9871f5963cc3f0d6 Command failed on smithi155 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6732037] upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:06:05 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732037/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732037/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e66924ff01eb4c28bf69fd441eb1d6c6 rgw multisite test failures [6732040] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:33:48 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732040/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732040/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f2d80d8ee074ce38a5b992b50a2933c Command failed on smithi120 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6732047] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:53:21 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732047/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732047/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9d9956d36503446bb9b045f6efacb7d9 Command failed on smithi176 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [6732038] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732038/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732038/ hit max job timeout Pass ================================================================= [6732020] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:22 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732020/ [6732022] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:27:04 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732022/ [6732023] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:20:21 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732023/ [6732025] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:02:00 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732025/ [6732026] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:09 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732026/ [6732027] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:09:31 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732027/ [6732028] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:09 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732028/ [6732029] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:58:07 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732029/ [6732030] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 01:39:40 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732030/ [6732032] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:05 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732032/ [6732033] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:32:43 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732033/ [6732034] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:55 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732034/ [6732035] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:12:55 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732035/ [6732036] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:56 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732036/ [6732039] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 02:14:39 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732039/ [6732041] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:54:12 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732041/ [6732042] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:50 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732042/ [6732043] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:15:11 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732043/ [6732044] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:14 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732044/ [6732045] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:14:18 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732045/ [6732046] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:02:07 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732046/ [6732048] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:38 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732048/ [6732049] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:22:35 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732049/ [6732050] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:09 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732050/ [6732051] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:02:30 info: http://pulpito.ceph.com/teuthology-2022-03-11_14:22:02-upgrade:octopus-x-quincy-distro-default-smithi/6732051/