2022-01-28T16:10:05.750 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-28T16:10:05.752 INFO:teuthology.results:subset: '111/120000' 2022-01-28T16:10:05.752 INFO:teuthology.results:seed: '696' 2022-01-28T20:15:22.773 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-28T20:15:22.803 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-29T00:54:45.228 INFO:teuthology.results:Tests finished! gathering results... 2022-01-29T00:55:13.127 INFO:scrape:Found 99 jobs 2022-01-29T00:55:19.418 WARNING:scrape:Not-understood crash indication 2022-01-28T17:16:29.157 INFO:tasks.rgw.c2.client.0.smithi097.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:19.419 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:19.437 WARNING:scrape:Not-understood crash indication 2022-01-28T17:16:29.157 INFO:tasks.rgw.c2.client.0.smithi097.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:19.439 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:19.458 WARNING:scrape:Not-understood crash indication 2022-01-28T17:16:29.157 INFO:tasks.rgw.c2.client.0.smithi097.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:19.459 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:19.476 WARNING:scrape:Not-understood crash indication 2022-01-28T17:16:29.157 INFO:tasks.rgw.c2.client.0.smithi097.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:19.477 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:19.627 WARNING:scrape:Not-understood crash indication 2022-01-28T18:12:12.142 INFO:tasks.rgw.c2.client.0.smithi146.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:19.628 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:19.646 WARNING:scrape:Not-understood crash indication 2022-01-28T18:12:12.142 INFO:tasks.rgw.c2.client.0.smithi146.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:19.647 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:20.022 WARNING:scrape:Not-understood crash indication 2022-01-28T16:49:28.471 INFO:tasks.rgw.c2.client.0.smithi148.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:20.023 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:20.040 WARNING:scrape:Not-understood crash indication 2022-01-28T16:49:28.471 INFO:tasks.rgw.c2.client.0.smithi148.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:20.041 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:21.055 WARNING:scrape:Not-understood crash indication 2022-01-28T20:24:26.267 INFO:tasks.rgw.c2.client.0.smithi106.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:21.056 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:21.076 WARNING:scrape:Not-understood crash indication 2022-01-28T20:24:26.267 INFO:tasks.rgw.c2.client.0.smithi106.stderr:daemon-helper: command crashed with signal 11 2022-01-29T00:55:21.077 WARNING:scrape:Not-understood crash indication 2022-01-29T00:55:21.078 INFO:scrape:Found 3 distinct failure reasons 2022-01-29T00:55:21.079 INFO:scrape:Failure: Command failed on smithi192 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-01-29T00:55:21.079 INFO:scrape:8 jobs: ['6646581', '6646591', '6646506', '6646556', '6646531', '6646517', '6646542', '6646567'] 2022-01-29T00:55:21.080 INFO:scrape:suites intersection: ['1-ceph-install/octopus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-29T00:55:21.080 INFO:scrape:suites union: ['1-ceph-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-29T00:55:21.081 INFO:scrape: 2022-01-29T00:55:21.081 INFO:scrape:Failure: rgw multisite test failures 2022-01-29T00:55:21.082 INFO:scrape:4 jobs: ['6646528', '6646552', '6646503', '6646577'] 2022-01-29T00:55:21.082 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters'] 2022-01-29T00:55:21.083 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/primary}', 'upgrade/secondary}'] 2022-01-29T00:55:21.083 INFO:scrape: 2022-01-29T00:55:21.084 INFO:scrape:Failure: Command failed on smithi183 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fa8f20ce-805e-11ec-8c35-001a4aab830c -- ceph mon dump -f json' 2022-01-29T00:55:21.084 INFO:scrape:1 jobs: ['6646539'] 2022-01-29T00:55:21.085 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0'] 2022-01-29T00:55:21.085 INFO:scrape: 2022-01-29T00:55:21.091 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/ failed: 13 dead: 0 running: 0 waiting: 0 queued: 0 passed: 86 Fail ================================================================= [6646503] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:09:17 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646503/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646503/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d1d7701b8944857961f511813c40d31 rgw multisite test failures [6646506] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:21:49 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646506/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646506/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a575131eace84079986739b1cf676066 Command failed on smithi156 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646517] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:52:33 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646517/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646517/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9933ece9f284c20965fa5a6de21bbfd Command failed on smithi137 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646528] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:05:56 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646528/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f9c591bbf94468c8209a9a61649e95f rgw multisite test failures [6646531] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:31:03 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646531/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646531/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e83f3bd98bf40f7a5f3df2bb068fd7d Command failed on smithi171 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646539] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:26:08 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646539/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646539/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3790e20861df432683cf7ef169900a71 Command failed on smithi183 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest- pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fa8f20ce-805e-11ec-8c35-001a4aab830c -- ceph mon dump -f json' [6646542] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:58:44 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646542/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de713322131342b5a70fd2d275565381 Command failed on smithi105 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646552] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:06:31 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646552/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646552/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13482501c68f483c89671b02b24c5370 rgw multisite test failures [6646556] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:46:22 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646556/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646556/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f5066409a0944da8c12f62942072135 Command failed on smithi198 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646567] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:58:54 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646567/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646567/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b94154928305433ba9ec7ccce845d6d6 Command failed on smithi135 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646577] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:09:28 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646577/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646577/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0602c64654154d9fa4681aed7b7c0977 rgw multisite test failures [6646581] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:44:03 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646581/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646581/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd0c57e8d7d442ab97071afb986330d2 Command failed on smithi192 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6646591] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:52:27 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646591/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646591/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa37b143a3a346a49efe0067434dbc96 Command failed on smithi085 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Pass ================================================================= [6646499] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:28:10 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646499/ [6646500] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:25:57 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646500/ [6646501] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:26:29 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646501/ [6646502] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:03:55 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646502/ [6646504] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:19:25 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646504/ [6646505] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:10:54 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646505/ [6646507] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:27 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646507/ [6646508] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:12 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646508/ [6646509] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:16:40 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646509/ [6646510] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:09:49 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646510/ [6646511] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:45 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646511/ [6646512] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:40 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646512/ [6646513] upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:10:36 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646513/ [6646514] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:54:49 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646514/ [6646515] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:49:43 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646515/ [6646516] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 01:43:36 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646516/ [6646518] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:06 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646518/ [6646519] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:17:11 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646519/ [6646520] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:27:55 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646520/ [6646521] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:43 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646521/ [6646522] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:55 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646522/ [6646523] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:41 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646523/ [6646524] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:46:14 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646524/ [6646525] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:49:10 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646525/ [6646526] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:14 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646526/ [6646527] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646527/ [6646529] upgrade/pacific-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:23:07 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646529/ [6646530] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 02:12:13 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646530/ [6646532] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:45 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646532/ [6646533] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:00 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646533/ [6646534] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:04:00 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646534/ [6646535] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:07:56 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646535/ [6646536] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:33 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646536/ [6646537] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:04 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646537/ [6646538] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:24:31 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646538/ [6646540] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:23:27 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646540/ [6646541] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 03:53:43 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646541/ [6646543] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:36 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646543/ [6646544] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:22:05 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646544/ [6646545] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:17:02 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646545/ [6646546] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:58 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646546/ [6646547] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:48 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646547/ [6646548] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:28 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646548/ [6646549] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:56:47 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646549/ [6646550] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:58:00 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646550/ [6646551] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:05 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646551/ [6646553] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:26:32 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646553/ [6646554] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:19:15 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646554/ [6646555] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 04:01:24 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646555/ [6646557] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:48 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646557/ [6646558] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:08:23 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646558/ [6646559] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:07:14 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646559/ [6646560] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:07 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646560/ [6646561] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:10 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646561/ [6646562] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:38 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646562/ [6646563] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:55:36 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646563/ [6646564] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:13:27 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646564/ [6646565] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 02:12:13 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646565/ [6646566] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:19 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646566/ [6646568] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:20 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646568/ [6646569] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:06:07 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646569/ [6646570] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:00:06 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646570/ [6646571] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:12 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646571/ [6646572] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:46 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646572/ [6646573] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646573/ [6646574] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:05:33 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646574/ [6646575] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:01:34 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646575/ [6646576] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:37 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646576/ [6646578] upgrade/pacific-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:22:08 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646578/ [6646579] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 01:38:40 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646579/ [6646580] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:18 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646580/ [6646582] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:52 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646582/ [6646583] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:13:31 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646583/ [6646584] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:13:07 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646584/ [6646585] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:01 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646585/ [6646586] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646586/ [6646587] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:14 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646587/ [6646588] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:56:25 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646588/ [6646589] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:53:33 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646589/ [6646590] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 04:35:11 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646590/ [6646592] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:37 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646592/ [6646593] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:47 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646593/ [6646594] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:21 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646594/ [6646595] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:37 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646595/ [6646596] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:10 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646596/ [6646597] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:08 info: http://pulpito.ceph.com/yuriw-2022-01-28_16:06:37-upgrade-wip-master-1.27.22-distro-default-smithi/6646597/