2022-01-06T17:12:58.542 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-06T17:12:58.546 INFO:teuthology.results:subset: '111/120000' 2022-01-06T17:12:58.546 INFO:teuthology.results:seed: '1872' 2022-01-06T21:29:03.590 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-06T21:29:03.627 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-07T07:08:49.753 INFO:teuthology.results:Tests finished! gathering results... 2022-01-07T07:09:01.671 INFO:scrape:Found 99 jobs 2022-01-07T07:09:01.878 WARNING:scrape:Not-understood crash indication 2022-01-06T19:44:02.225 INFO:tasks.rgw.c2.client.0.smithi167.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:01.879 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:01.903 WARNING:scrape:Not-understood crash indication 2022-01-06T19:44:02.225 INFO:tasks.rgw.c2.client.0.smithi167.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:01.904 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:01.931 WARNING:scrape:Not-understood crash indication 2022-01-06T19:44:02.225 INFO:tasks.rgw.c2.client.0.smithi167.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:01.932 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:01.978 WARNING:scrape:Not-understood crash indication 2022-01-06T19:44:02.225 INFO:tasks.rgw.c2.client.0.smithi167.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:01.979 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.255 WARNING:scrape:Not-understood crash indication 2022-01-06T17:55:25.338 INFO:tasks.rgw.c2.client.0.smithi192.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:02.256 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.284 WARNING:scrape:Not-understood crash indication 2022-01-06T17:55:25.338 INFO:tasks.rgw.c2.client.0.smithi192.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:02.285 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.488 WARNING:scrape:Not-understood crash indication 2022-01-06T21:02:11.711 INFO:tasks.rgw.c2.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:02.489 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.515 WARNING:scrape:Not-understood crash indication 2022-01-06T21:02:11.711 INFO:tasks.rgw.c2.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:02.516 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.719 WARNING:scrape:Not-understood crash indication 2022-01-06T18:42:14.602 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:02.720 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.745 WARNING:scrape:Not-understood crash indication 2022-01-06T18:42:14.602 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2022-01-07T07:09:02.746 WARNING:scrape:Not-understood crash indication 2022-01-07T07:09:02.746 INFO:scrape:Found 3 distinct failure reasons 2022-01-07T07:09:02.747 INFO:scrape:Dead: b'2022-01-07T07:04:52.223 DEBUG:teuthology.exit:Finished running handlers' 2022-01-07T07:09:02.748 INFO:scrape:1 jobs: ['6598941'] 2022-01-07T07:09:02.748 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/v16.2.4', 'upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-07T07:09:02.748 INFO:scrape: 2022-01-07T07:09:02.749 INFO:scrape:Failure: Command failed on smithi198 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-01-07T07:09:02.749 INFO:scrape:8 jobs: ['6598931', '6599010', '6598981', '6598858', '6598908', '6598959', '6598880', '6599030'] 2022-01-07T07:09:02.750 INFO:scrape:suites intersection: ['1-ceph-install/octopus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-07T07:09:02.750 INFO:scrape:suites union: ['1-ceph-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-07T07:09:02.751 INFO:scrape: 2022-01-07T07:09:02.751 INFO:scrape:Failure: rgw multisite test failures 2022-01-07T07:09:02.752 INFO:scrape:4 jobs: ['6598951', '6598852', '6599001', '6598902'] 2022-01-07T07:09:02.752 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters'] 2022-01-07T07:09:02.753 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/octopus-x/rgw-multisite/{clusters', 'upgrade/primary}', 'upgrade/secondary}'] 2022-01-07T07:09:02.753 INFO:scrape: 2022-01-07T07:09:02.760 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/ failed: 12 dead: 1 running: 0 waiting: 0 queued: 0 passed: 86 Fail ================================================================= [6598852] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:03:28 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598852/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598852/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b85bcca47177409a952b2fb2333643c6 rgw multisite test failures [6598858] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:37:06 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598858/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598858/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba1cee22e40440e9966bd05626c23749 Command failed on smithi111 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6598880] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:39:47 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598880/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c62e7ac9e407494395eac003db30e6cf Command failed on smithi185 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6598902] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:04:06 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598902/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598902/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0bb3c42d41254e21ba54dc9dafa32d8b rgw multisite test failures [6598908] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:45:57 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598908/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598908/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40f3f64f7c47433e8077cc417477b184 Command failed on smithi155 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6598931] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:47:07 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598931/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598931/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51bfbaf7eee94fa6852e3c5fe1a95d06 Command failed on smithi198 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6598951] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:03:33 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598951/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598951/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34a8df96e23c46ed9b33d92493c62bc1 rgw multisite test failures [6598959] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 04:07:56 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598959/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598959/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7994205ccf8b453a81e08bf98b39829c Command failed on smithi123 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6598981] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:47:42 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598981/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598981/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea625cae6f2c42beb35dbcc63d17d944 Command failed on smithi166 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6599001] upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:03:21 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599001/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599001/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e48a19dfeaab410386d37be059b07ab1 rgw multisite test failures [6599010] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 03:29:07 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599010/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599010/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85881964b519456180d335cda140868b Command failed on smithi198 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6599030] upgrade/octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 01:51:30 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599030/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599030/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81ba65387ab649e2885b601eed32d08c Command failed on smithi194 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [6598941] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598941/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598941/ hit max job timeout Pass ================================================================= [6598844] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:11:27 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598844/ [6598846] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:10:06 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598846/ [6598848] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:26:34 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598848/ [6598850] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:27 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598850/ [6598854] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:15:43 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598854/ [6598856] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 00:46:56 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598856/ [6598860] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:27 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598860/ [6598862] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:25 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598862/ [6598864] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:16:40 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598864/ [6598866] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:20:05 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598866/ [6598868] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:48 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598868/ [6598870] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:18 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598870/ [6598872] upgrade/cephfs/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598872/ [6598874] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:03:18 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598874/ [6598876] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:00:19 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598876/ [6598878] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 00:46:22 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598878/ [6598882] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:00 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598882/ [6598884] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:13:26 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598884/ [6598886] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:13:48 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598886/ [6598888] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:51 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598888/ [6598890] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:14 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598890/ [6598892] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:24 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598892/ [6598894] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:45:40 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598894/ [6598896] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:05:25 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598896/ [6598898] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:42 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598898/ [6598900] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:19:32 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598900/ [6598904] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:16:41 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598904/ [6598906] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 00:44:23 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598906/ [6598910] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:01 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598910/ [6598912] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:15 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598912/ [6598914] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:20:34 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598914/ [6598916] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:04:17 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598916/ [6598918] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:09 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598918/ [6598921] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:44 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598921/ [6598923] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:12:35 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598923/ [6598925] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:25:17 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598925/ [6598927] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:21:26 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598927/ [6598929] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 00:50:05 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598929/ [6598933] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:09 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598933/ [6598935] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:20:37 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598935/ [6598937] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:11:42 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598937/ [6598939] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:50 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598939/ [6598943] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:37 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598943/ [6598945] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:17:01 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598945/ [6598947] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:09:39 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598947/ [6598949] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:27 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598949/ [6598953] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:26:03 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598953/ [6598955] upgrade/pacific-x/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:15:49 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598955/ [6598957] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 00:48:15 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598957/ [6598961] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:03 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598961/ [6598963] upgrade/pacific-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:41:50 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598963/ [6598965] upgrade/octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:08:45 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598965/ [6598967] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:16 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598967/ [6598969] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:58 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598969/ [6598971] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:17 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598971/ [6598973] upgrade/octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:02:56 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598973/ [6598975] upgrade/pacific-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:49:18 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598975/ [6598977] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 00:45:42 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598977/ [6598979] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:53 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598979/ [6598983] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:11 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598983/ [6598985] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:24:37 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598985/ [6598987] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:08:04 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598987/ [6598989] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:20 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598989/ [6598992] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:45 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598992/ [6598993] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:20:13 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598993/ [6598996] upgrade/pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:00:43 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598996/ [6598998] upgrade/octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:57:54 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6598998/ [6599000] upgrade/octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:22 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599000/ [6599004] upgrade/pacific-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:24:05 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599004/ [6599006] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} time: 00:46:35 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599006/ [6599008] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:38 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599008/ [6599012] upgrade/octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:06:50 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599012/ [6599014] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:21:21 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599014/ [6599016] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:31 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599016/ [6599018] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:48 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599018/ [6599020] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599020/ [6599022] upgrade/octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:07 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599022/ [6599024] upgrade/octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:59:55 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599024/ [6599026] upgrade/pacific-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:00:35 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599026/ [6599028] upgrade/octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} time: 00:48:11 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599028/ [6599032] upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:04 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599032/ [6599034] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:52 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599034/ [6599036] upgrade/pacific-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:18:15 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599036/ [6599038] upgrade/octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:14:18 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599038/ [6599040] upgrade/octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:18:25 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599040/ [6599042] upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:48 info: http://pulpito.ceph.com/yuriw-2022-01-06_15:53:32-upgrade-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599042/