2023-07-13T03:38:05.533 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T03:38:05.534 INFO:teuthology.results:subset: '1/999' 2023-07-13T03:38:05.534 INFO:teuthology.results:seed: '3772' 2023-07-13T04:31:12.015 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T04:31:12.019 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-13T05:34:16.604 INFO:teuthology.results:Tests finished! gathering results... 2023-07-13T05:34:18.768 INFO:scrape:Found 95 jobs 2023-07-13T05:34:19.290 INFO:scrape:Found 6 distinct failure reasons 2023-07-13T05:34:19.291 INFO:scrape:Failure: Cannot connect to remote host smithi156 2023-07-13T05:34:19.292 INFO:scrape:11 jobs: ['7335707', '7335716', '7335780', '7335759', '7335766', '7335730', '7335733', '7335753', '7335775', '7335782', '7335752'] 2023-07-13T05:34:19.292 INFO:scrape:suites intersection: [] 2023-07-13T05:34:19.292 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous-v1only', '1-install/mimic-v1only', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-start', '2-services/nfs-ingress-rgw-bucket', '2-services/rgw', '3-final}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'orch:cephadm/with-work/{0-distro/ubuntu_18.04', 'rados', 'start', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2023-07-13T05:34:19.293 INFO:scrape: 2023-07-13T05:34:19.293 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2023-07-13T05:34:19.293 INFO:scrape:2 jobs: ['7335728', '7335774'] 2023-07-13T05:34:19.294 INFO:scrape:suites intersection: ['orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_nfs}'] 2023-07-13T05:34:19.294 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_nfs}'] 2023-07-13T05:34:19.294 INFO:scrape: 2023-07-13T05:34:19.294 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78d0ef1aa8678d5dee35caad62b7f72716369c35 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-07-13T05:34:19.295 INFO:scrape:1 jobs: ['7335699'] 2023-07-13T05:34:19.295 INFO:scrape:suites: ['orch:cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'task/test_e2e}'] 2023-07-13T05:34:19.295 INFO:scrape: 2023-07-13T05:34:19.296 INFO:scrape:Failure: Command failed on smithi088 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a0759ef2-2138-11ee-9b32-001a4aab830c -- ceph orch daemon add osd smithi088:vg_nvme/lv_4' 2023-07-13T05:34:19.296 INFO:scrape:1 jobs: ['7335783'] 2023-07-13T05:34:19.296 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'roles', 'tasks/{0-from/v16.2.4'] 2023-07-13T05:34:19.296 INFO:scrape: 2023-07-13T05:34:19.297 INFO:scrape:Failure: 'package_manager_version' 2023-07-13T05:34:19.297 INFO:scrape:1 jobs: ['7335703'] 2023-07-13T05:34:19.297 INFO:scrape:suites: ['cluster/{fixed-3', 'openstack}', 'orch:cephadm/rbd_iscsi/{base/install', 'pool/datapool', 'supported-random-distro$/{centos_8}', 'workloads/ceph_iscsi}'] 2023-07-13T05:34:19.298 INFO:scrape: 2023-07-13T05:34:19.298 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=78d0ef1aa8678d5dee35caad62b7f72716369c35 2023-07-13T05:34:19.298 INFO:scrape:1 jobs: ['7335747'] 2023-07-13T05:34:19.298 INFO:scrape:suites: ['orch:cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2023-07-13T05:34:19.299 INFO:scrape: 2023-07-13T05:34:19.302 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/ failed: 17 dead: 0 running: 0 waiting: 0 queued: 0 passed: 78 Fail ================================================================= [7335699] orch:cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:28:53 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335699/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335699/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cd81a66f3bf49d78f51605e31c8771a Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78d0ef1aa8678d5dee35caad62b7f72716369c35 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7335703] orch:cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:18:11 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c637d272334945e987ba0a9ca0a0034a 'package_manager_version' [7335707] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335707/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335707/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7e200e4802443518a64764e617a7922 Cannot connect to remote host smithi156 [7335716] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335716/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335716/ sentry: https://sentry.ceph.com/organizations/ceph/?query=376c0df516bb47e5820aece7c957a0ca Cannot connect to remote host smithi140 [7335728] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:30:19 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335728/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335728/ sentry: https://sentry.ceph.com/organizations/ceph/?query=702d4792340a4921a6b3d45b2103518c Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [7335730] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335730/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335730/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f25b672b31a34dfaa87542fb5c77c6ef Cannot connect to remote host smithi178 [7335733] orch:cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335733/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335733/ sentry: https://sentry.ceph.com/organizations/ceph/?query=109624a3d7b949bc884d18cda95b9a7a Cannot connect to remote host smithi190 [7335747] orch:cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:09:19 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335747/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18fd83bf39664b6386f003adeb0232db Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =78d0ef1aa8678d5dee35caad62b7f72716369c35 [7335752] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335752/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335752/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5a34ae37ca7456baebc61f118d455e9 Cannot connect to remote host smithi098 [7335753] orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335753/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335753/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e521f95369741529bdc66890b5c0ef7 Cannot connect to remote host smithi118 [7335759] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335759/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335759/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7d91f82bebd46ccb1b5ee1fb7eb48c8 Cannot connect to remote host smithi114 [7335766] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335766/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335766/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa4c33f580044c2ebcb675fba5a009e1 Cannot connect to remote host smithi040 [7335774] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:27:31 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335774/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c8db42acc3bd4e08a878547af312bf40 Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [7335775] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335775/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335775/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf53908fc8874593910346c7f14dadb7 Cannot connect to remote host smithi169 [7335780] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335780/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335780/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc9d7b8187904a5d965730a85002f11f Cannot connect to remote host smithi098 [7335782] orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335782/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335782/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0751661db56b40aabb769006bf05c349 Cannot connect to remote host smithi183 [7335783] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:14:14 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335783/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335783/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fe1c7ee1caa4b13bd273d1e8a71fec3 Command failed on smithi088 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a0759ef2-2138-11ee-9b32-001a4aab830c -- ceph orch daemon add osd smithi088:vg_nvme/lv_4' Pass ================================================================= [7335693] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:44 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335693/ [7335694] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:41:21 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335694/ [7335695] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:34:07 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335695/ [7335696] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:28 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335696/ [7335697] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:39:23 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335697/ [7335698] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:43:10 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335698/ [7335700] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:53 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335700/ [7335701] orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:26 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335701/ [7335702] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:14:02 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335702/ [7335704] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:18:21 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335704/ [7335705] orch:cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:19:42 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335705/ [7335706] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:17:43 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335706/ [7335708] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:20:30 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335708/ [7335709] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:24:59 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335709/ [7335710] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:39:08 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335710/ [7335711] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:22:19 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335711/ [7335712] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:06 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335712/ [7335713] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:35:29 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335713/ [7335714] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:52 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335714/ [7335715] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:10:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335715/ [7335717] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:43:23 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335717/ [7335718] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:31:18 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335718/ [7335719] orch:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:24:06 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335719/ [7335720] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:20 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335720/ [7335721] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:35:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335721/ [7335722] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:39 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335722/ [7335723] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:55:49 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335723/ [7335724] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:39:58 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335724/ [7335725] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:26:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335725/ [7335726] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:29:18 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335726/ [7335727] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:48 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335727/ [7335729] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:25:09 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335729/ [7335731] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:59 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335731/ [7335732] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:44:33 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335732/ [7335734] orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:28:05 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335734/ [7335735] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:21:13 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335735/ [7335736] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:56 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335736/ [7335737] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:38:13 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335737/ [7335738] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:20:10 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335738/ [7335739] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:26:32 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335739/ [7335740] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:40:09 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335740/ [7335741] orch:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:23:00 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335741/ [7335742] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:48:43 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335742/ [7335743] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:40 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335743/ [7335744] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:46:08 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335744/ [7335745] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:58:47 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335745/ [7335746] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:35:08 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335746/ [7335748] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:36:48 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335748/ [7335749] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:17:43 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335749/ [7335750] orch:cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} time: 00:17:53 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335750/ [7335751] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:17:36 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335751/ [7335754] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:39:29 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335754/ [7335755] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:20:52 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335755/ [7335756] orch:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:47 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335756/ [7335757] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:19:44 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335757/ [7335758] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:23:06 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335758/ [7335760] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:32 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335760/ [7335761] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:11:45 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335761/ [7335762] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:34 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335762/ [7335763] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:36:13 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335763/ [7335764] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:41:59 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335764/ [7335765] orch:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:28:58 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335765/ [7335767] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:19:30 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335767/ [7335768] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:22:58 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335768/ [7335769] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:52 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335769/ [7335770] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:47:29 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335770/ [7335771] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:32:36 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335771/ [7335772] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:46 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335772/ [7335773] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:20:56 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335773/ [7335776] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:22:57 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335776/ [7335777] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:23:48 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335777/ [7335778] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:51:43 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335778/ [7335779] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:34:47 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335779/ [7335781] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:24:21 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335781/ [7335784] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:25:17 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335784/ [7335785] orch:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:55:54 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335785/ [7335786] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:14 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335786/ [7335787] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:35:56 info: http://pulpito.ceph.com/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335787/