2022-08-21T03:35:26.150 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-21T03:35:26.153 INFO:teuthology.results:subset: '32193/99999' 2022-08-21T03:35:26.153 INFO:teuthology.results:seed: '407' 2022-08-21T08:29:42.284 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-21T08:29:42.314 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-21T19:16:44.074 INFO:teuthology.results:Tests finished! gathering results... 2022-08-21T19:17:17.595 INFO:scrape:Found 413 jobs 2022-08-21T19:17:19.453 INFO:scrape:Found 8 distinct failure reasons 2022-08-21T19:17:19.454 INFO:scrape:Failure: Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 59e877d6-2114-11ed-8431-001a4aab830c -e sha1=5643735ae14ffac8fa75c218b7e8a181a50c0de8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2022-08-21T19:17:19.455 INFO:scrape:4 jobs: ['6982442', '6982651', '6982713', '6982508'] 2022-08-21T19:17:19.455 INFO:scrape:suites intersection: ['1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-08-21T19:17:19.456 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-08-21T19:17:19.456 INFO:scrape: 2022-08-21T19:17:19.457 INFO:scrape:Failure: Command failed on smithi077 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' 2022-08-21T19:17:19.457 INFO:scrape:4 jobs: ['6982518', '6982703', '6982389', '6982650'] 2022-08-21T19:17:19.458 INFO:scrape:suites intersection: [] 2022-08-21T19:17:19.458 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'clusters/{2-node-mgr}', 'debug/mgr', 'k8s/1.21', 'mon_election/connectivity', 'net/calico', 'rados/dashboard/{centos_8.stream_container_tools', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'random-objectstore$/{bluestore-comp-snappy}', 'rook/1.6.2}', 'rook/master}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2022-08-21T19:17:19.458 INFO:scrape: 2022-08-21T19:17:19.459 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7458e41e690802021052863e5164a4143b1d499e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2022-08-21T19:17:19.459 INFO:scrape:1 jobs: ['6982428'] 2022-08-21T19:17:19.460 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-08-21T19:17:19.460 INFO:scrape: 2022-08-21T19:17:19.461 INFO:scrape:Dead: b'2022-08-21T19:09:55.455 DEBUG:teuthology.exit:Finished running handlers' 2022-08-21T19:17:19.461 INFO:scrape:1 jobs: ['6982596'] 2022-08-21T19:17:19.461 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/thrash-eio', 'supported-random-distro$/{centos_8}}'] 2022-08-21T19:17:19.462 INFO:scrape: 2022-08-21T19:17:19.462 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2022-08-21T19:17:19.463 INFO:scrape:1 jobs: ['6982541'] 2022-08-21T19:17:19.463 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-08-21T19:17:19.464 INFO:scrape: 2022-08-21T19:17:19.464 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi139.front.sepia.ceph.com: ['type=AVC msg=audit(1661064763.023:6436): avc: denied { ioctl } for pid=60319 comm="iptables" path="/var/lib/containers/storage/overlay/299e2a0ea955a55adae92b8a316ba2f4e4f8c140a23cc97105e91d863a9c1774/merged" dev="overlay" ino=3934135 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1661064763.265:6439): avc: denied { ioctl } for pid=60357 comm="iptables" path="/var/lib/containers/storage/overlay/299e2a0ea955a55adae92b8a316ba2f4e4f8c140a23cc97105e91d863a9c1774/merged" dev="overlay" ino=3934135 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-08-21T19:17:19.464 INFO:scrape:1 jobs: ['6982542'] 2022-08-21T19:17:19.465 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-08-21T19:17:19.465 INFO:scrape: 2022-08-21T19:17:19.466 INFO:scrape:Failure: Command failed on smithi101 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5643735ae14ffac8fa75c218b7e8a181a50c0de8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a09a93a6-2116-11ed-8431-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-08-21T19:17:19.466 INFO:scrape:1 jobs: ['6982473'] 2022-08-21T19:17:19.467 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-08-21T19:17:19.467 INFO:scrape: 2022-08-21T19:17:19.467 INFO:scrape:Failure: Command failed (workunit test rados/test_python.sh) on smithi050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7458e41e690802021052863e5164a4143b1d499e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' 2022-08-21T19:17:19.468 INFO:scrape:1 jobs: ['6982372'] 2022-08-21T19:17:19.468 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8}', 'tasks/rados_python}'] 2022-08-21T19:17:19.469 INFO:scrape: 2022-08-21T19:17:19.480 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/ failed: 13 dead: 1 running: 0 waiting: 0 queued: 0 passed: 399 Fail ================================================================= [6982372] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982372/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982372/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c165efd504f42cdb4cb4dd99b985e7f Command failed (workunit test rados/test_python.sh) on smithi050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7458e41e690802021052863e5164a4143b1d499e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [6982389] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:04:22 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982389/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad4371fbab6c47818ea116378dc38f48 Command failed on smithi131 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6982428] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982428/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982428/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c0355f3805a4026aa24b7ba9ae11b65 Command failed (workunit test cephadm/test_cephadm.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7458e41e690802021052863e5164a4143b1d499e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [6982442] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:19:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0d13bdbe7ae4fb890f98068a2e7aed3 Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 59e877d6-2114-11ed-8431-001a4aab830c -e sha1=5643735ae14ffac8fa75c218b7e8a181a50c0de8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6982473] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982473/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982473/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c98c19e75aa4c4d8792c0b50da2a454 Command failed on smithi101 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:5643735ae14ffac8fa75c218b7e8a181a50c0de8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a09a93a6-2116-11ed-8431-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6982508] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982508/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982508/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e208bbcbb32343bfba9713b240147da9 Command failed on smithi110 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aca160b4-2119-11ed-8431-001a4aab830c -e sha1=5643735ae14ffac8fa75c218b7e8a181a50c0de8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6982518] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:04:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982518/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982518/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c8968878d8e340ddb371f97ba63c89f8 Command failed on smithi077 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6982541] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:26:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982541/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982541/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df56b150feb64c6796923901343316ec Command failed (workunit test rados/test.sh) on smithi160 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7458e41e690802021052863e5164a4143b1d499e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6982542] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:14:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982542/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982542/ SELinux denials found on ubuntu@smithi139.front.sepia.ceph.com: ['type=AVC msg=audit(1661064763.023:6436): avc: denied { ioctl } for pid=60319 comm="iptables" path="/var/lib/containers/storage/overlay/299e2a0ea955a55ad ae92b8a316ba2f4e4f8c140a23cc97105e91d863a9c1774/merged" dev="overlay" ino=3934135 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1661064763.265:6439): avc: denied { ioctl } for pid=60357 comm="iptables" path="/var/lib/containers/storage/ov erlay/299e2a0ea955a55adae92b8a316ba2f4e4f8c140a23cc97105e91d863a9c1774/merg ed" dev="overlay" ino=3934135 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6982650] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:04:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982650/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982650/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f3e0982651b14f97bb4aec45a710ef56 Command failed on smithi088 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6982651] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982651/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab8029039ced417c89f9c2ecbc4b87b0 Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 883dbe5a-2125-11ed-8431-001a4aab830c -e sha1=5643735ae14ffac8fa75c218b7e8a181a50c0de8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6982703] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:02:33 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982703/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52694628ac6b4a8dbd418143b17ffd23 Command failed on smithi145 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6982713] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982713/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982713/ sentry: https://sentry.ceph.com/organizations/ceph/?query=daab770d351d4c2fadfbbe8bb71a4c7f Command failed on smithi121 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d41c7a6e-212a-11ed-8431-001a4aab830c -e sha1=5643735ae14ffac8fa75c218b7e8a181a50c0de8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' Dead ================================================================= [6982596] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982596/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982596/ hit max job timeout Pass ================================================================= [6982324] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:05:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982324/ [6982325] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982325/ [6982326] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982326/ [6982327] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982327/ [6982328] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982328/ [6982329] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:05:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982329/ [6982330] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982330/ [6982331] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982331/ [6982332] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982332/ [6982333] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 01:08:37 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982333/ [6982334] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982334/ [6982335] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982335/ [6982336] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982336/ [6982337] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982337/ [6982338] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982338/ [6982339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982339/ [6982340] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982340/ [6982341] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982341/ [6982342] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 01:27:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982342/ [6982343] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:45:49 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982343/ [6982344] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:20:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982344/ [6982345] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:34:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982345/ [6982346] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982346/ [6982347] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982347/ [6982348] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982348/ [6982349] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982349/ [6982350] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:07:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982350/ [6982351] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982351/ [6982352] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982352/ [6982353] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982353/ [6982354] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:05:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982354/ [6982355] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982355/ [6982356] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982356/ [6982357] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:11 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982357/ [6982358] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:19:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982358/ [6982359] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982359/ [6982360] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982360/ [6982361] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982361/ [6982362] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982362/ [6982363] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982363/ [6982364] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982364/ [6982365] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982365/ [6982366] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982366/ [6982367] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982367/ [6982368] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:45:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982368/ [6982369] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982369/ [6982370] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:32:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982370/ [6982371] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982371/ [6982373] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:49:27 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982373/ [6982374] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982374/ [6982375] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:25:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982375/ [6982376] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982376/ [6982377] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} time: 00:29:20 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982377/ [6982378] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982378/ [6982379] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:17:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982379/ [6982380] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982380/ [6982381] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:23:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982381/ [6982382] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:32:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982382/ [6982383] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982383/ [6982384] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982384/ [6982385] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:38:31 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982385/ [6982386] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982386/ [6982387] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982387/ [6982388] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982388/ [6982390] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:21:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982390/ [6982391] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982391/ [6982392] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982392/ [6982393] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982393/ [6982394] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:33:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982394/ [6982395] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:57:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982395/ [6982396] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:25:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982396/ [6982397] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982397/ [6982398] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982398/ [6982399] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982399/ [6982400] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982400/ [6982401] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/insights} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982401/ [6982402] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982402/ [6982403] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:07 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982403/ [6982404] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982404/ [6982405] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982405/ [6982406] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982406/ [6982407] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982407/ [6982408] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982408/ [6982409] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982409/ [6982410] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982410/ [6982411] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982411/ [6982412] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982412/ [6982413] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:50:41 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982413/ [6982414] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:20:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982414/ [6982415] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982415/ [6982416] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982416/ [6982417] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982417/ [6982418] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982418/ [6982419] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:49:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982419/ [6982420] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:28:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982420/ [6982421] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982421/ [6982422] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982422/ [6982423] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982423/ [6982424] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:33:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982424/ [6982425] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:52:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982425/ [6982426] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982426/ [6982427] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982427/ [6982429] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:31:07 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982429/ [6982430] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982430/ [6982431] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982431/ [6982432] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982432/ [6982433] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:31:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982433/ [6982434] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982434/ [6982435] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 01:11:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982435/ [6982436] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:29:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982436/ [6982437] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982437/ [6982438] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:40:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982438/ [6982439] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982439/ [6982440] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982440/ [6982441] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:23:41 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982441/ [6982443] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:29:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982443/ [6982444] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982444/ [6982445] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982445/ [6982446] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982446/ [6982447] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982447/ [6982448] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982448/ [6982449] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:29:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982449/ [6982450] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982450/ [6982451] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:32:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982451/ [6982452] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 04:30:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982452/ [6982453] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982453/ [6982454] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 01:03:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982454/ [6982455] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:05:20 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982455/ [6982456] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 02:06:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982456/ [6982457] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:06:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982457/ [6982458] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982458/ [6982459] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982459/ [6982460] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:11 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982460/ [6982461] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:15:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982461/ [6982462] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:19:24 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982462/ [6982463] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:29:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982463/ [6982464] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982464/ [6982465] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:13:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982465/ [6982466] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982466/ [6982467] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:39:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982467/ [6982468] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:42:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982468/ [6982469] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982469/ [6982470] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982470/ [6982471] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982471/ [6982472] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982472/ [6982474] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:28:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982474/ [6982475] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:38:05 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982475/ [6982476] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:30:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982476/ [6982477] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982477/ [6982478] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:35:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982478/ [6982479] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982479/ [6982480] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982480/ [6982481] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982481/ [6982482] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982482/ [6982483] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982483/ [6982484] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982484/ [6982485] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982485/ [6982486] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982486/ [6982487] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982487/ [6982488] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982488/ [6982489] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:21:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982489/ [6982490] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982490/ [6982491] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:33:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982491/ [6982492] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:12:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982492/ [6982493] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982493/ [6982494] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982494/ [6982495] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982495/ [6982496] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982496/ [6982497] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:55:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982497/ [6982498] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982498/ [6982499] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982499/ [6982500] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982500/ [6982501] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982501/ [6982502] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:19:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982502/ [6982503] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982503/ [6982504] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982504/ [6982505] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982505/ [6982506] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:20:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982506/ [6982507] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982507/ [6982509] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982509/ [6982510] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:19:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982510/ [6982511] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982511/ [6982512] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982512/ [6982513] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982513/ [6982514] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982514/ [6982515] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:22:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982515/ [6982516] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982516/ [6982517] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982517/ [6982519] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982519/ [6982520] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982520/ [6982521] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982521/ [6982522] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982522/ [6982523] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982523/ [6982524] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982524/ [6982525] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982525/ [6982526] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982526/ [6982527] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:34:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982527/ [6982528] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982528/ [6982529] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982529/ [6982530] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982530/ [6982531] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982531/ [6982532] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:27:50 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982532/ [6982533] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:32:37 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982533/ [6982534] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:51:17 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982534/ [6982535] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982535/ [6982536] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982536/ [6982537] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982537/ [6982538] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982538/ [6982539] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982539/ [6982540] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982540/ [6982543] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:23:17 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982543/ [6982544] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982544/ [6982545] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982545/ [6982546] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982546/ [6982547] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:17 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982547/ [6982548] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982548/ [6982549] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982549/ [6982550] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982550/ [6982551] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:32:13 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982551/ [6982552] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982552/ [6982553] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982553/ [6982554] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:47:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982554/ [6982555] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982555/ [6982556] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:26:56 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982556/ [6982557] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:42:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982557/ [6982558] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982558/ [6982559] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982559/ [6982560] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982560/ [6982561] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:05:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982561/ [6982562] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982562/ [6982563] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982563/ [6982564] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982564/ [6982565] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:12 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982565/ [6982566] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982566/ [6982567] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982567/ [6982568] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/workunits} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982568/ [6982569] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982569/ [6982570] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982570/ [6982571] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:41:56 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982571/ [6982572] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:10 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982572/ [6982573] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982573/ [6982574] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:41 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982574/ [6982575] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982575/ [6982576] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982576/ [6982577] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:23:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982577/ [6982578] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982578/ [6982579] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982579/ [6982580] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:49:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982580/ [6982581] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982581/ [6982582] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:25:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982582/ [6982583] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:54:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982583/ [6982584] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982584/ [6982585] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982585/ [6982586] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982586/ [6982587] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:30:30 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982587/ [6982588] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982588/ [6982589] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:39:32 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982589/ [6982590] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982590/ [6982591] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982591/ [6982592] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982592/ [6982593] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982593/ [6982594] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:32 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982594/ [6982595] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982595/ [6982597] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:03:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982597/ [6982598] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982598/ [6982599] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982599/ [6982600] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982600/ [6982601] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982601/ [6982602] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982602/ [6982603] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982603/ [6982604] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982604/ [6982605] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/crash} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982605/ [6982606] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982606/ [6982607] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982607/ [6982608] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982608/ [6982609] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:22 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982609/ [6982610] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982610/ [6982611] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:33:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982611/ [6982612] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982612/ [6982613] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982613/ [6982614] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982614/ [6982615] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982615/ [6982616] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982616/ [6982617] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:21:11 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982617/ [6982618] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982618/ [6982619] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982619/ [6982620] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:29:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982620/ [6982621] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982621/ [6982622] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:34:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982622/ [6982623] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982623/ [6982624] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982624/ [6982625] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982625/ [6982626] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982626/ [6982627] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982627/ [6982628] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:31:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982628/ [6982629] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982629/ [6982630] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:43:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982630/ [6982631] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982631/ [6982632] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982632/ [6982633] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982633/ [6982634] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:34:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982634/ [6982635] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:19:56 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982635/ [6982636] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982636/ [6982637] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982637/ [6982638] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:49:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982638/ [6982639] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982639/ [6982640] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982640/ [6982641] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:24:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982641/ [6982642] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982642/ [6982643] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:53:49 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982643/ [6982644] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:12 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982644/ [6982645] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982645/ [6982646] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982646/ [6982647] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982647/ [6982648] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/failover} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982648/ [6982649] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:28:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982649/ [6982652] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982652/ [6982653] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982653/ [6982654] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982654/ [6982655] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:32:43 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982655/ [6982656] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982656/ [6982657] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:35:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982657/ [6982658] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982658/ [6982659] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:57:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982659/ [6982660] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982660/ [6982661] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982661/ [6982662] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:05:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982662/ [6982663] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982663/ [6982664] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:31:54 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982664/ [6982665] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982665/ [6982666] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982666/ [6982667] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982667/ [6982668] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982668/ [6982669] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982669/ [6982670] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982670/ [6982671] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982671/ [6982672] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982672/ [6982673] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982673/ [6982674] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 00:29:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982674/ [6982675] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982675/ [6982676] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982676/ [6982677] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982677/ [6982678] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982678/ [6982679] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982679/ [6982680] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:05:38 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982680/ [6982681] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982681/ [6982682] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:44:19 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982682/ [6982683] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:29:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982683/ [6982684] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:00 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982684/ [6982685] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:50:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982685/ [6982686] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982686/ [6982687] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982687/ [6982688] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/insights} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982688/ [6982689] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:25:09 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982689/ [6982690] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982690/ [6982691] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982691/ [6982692] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982692/ [6982693] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982693/ [6982694] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982694/ [6982695] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:41 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982695/ [6982696] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982696/ [6982697] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982697/ [6982698] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982698/ [6982699] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:18:23 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982699/ [6982700] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:48:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982700/ [6982701] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 01:06:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982701/ [6982702] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:54:50 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982702/ [6982704] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982704/ [6982705] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:51:44 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982705/ [6982706] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982706/ [6982707] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982707/ [6982708] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982708/ [6982709] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:20:39 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982709/ [6982710] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 01:19:45 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982710/ [6982711] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982711/ [6982712] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982712/ [6982714] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982714/ [6982715] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982715/ [6982716] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982716/ [6982717] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982717/ [6982718] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982718/ [6982719] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982719/ [6982720] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982720/ [6982721] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982721/ [6982722] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982722/ [6982723] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} time: 00:24:13 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982723/ [6982724] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982724/ [6982725] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982725/ [6982726] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:29 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982726/ [6982727] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982727/ [6982728] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982728/ [6982729] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982729/ [6982730] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:22 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982730/ [6982731] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982731/ [6982732] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:29:21 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982732/ [6982733] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982733/ [6982734] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:29:03 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982734/ [6982735] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982735/ [6982736] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:25:25 info: http://pulpito.ceph.com/teuthology-2022-08-21_03:31:03-rados-pacific-distro-default-smithi/6982736/