2022-07-04T00:33:18.037 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-04T00:33:18.039 INFO:teuthology.results:subset: '6116/99999' 2022-07-04T00:33:18.039 INFO:teuthology.results:seed: '6139' 2022-07-04T06:32:54.027 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-04T06:32:54.052 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-04T17:43:10.678 INFO:teuthology.results:Tests finished! gathering results... 2022-07-04T17:43:46.733 INFO:scrape:Found 413 jobs 2022-07-04T17:43:53.552 INFO:scrape:Found 12 distinct failure reasons 2022-07-04T17:43:53.554 INFO:scrape:Failure: Command failed on smithi026 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2022-07-04T17:43:53.555 INFO:scrape:8 jobs: ['6911336', '6911298', '6911392', '6911369', '6911442', '6911361', '6911398', '6911264'] 2022-07-04T17:43:53.555 INFO:scrape:suites intersection: [] 2022-07-04T17:43:53.556 INFO:scrape:suites union: ['0-nvme-loop', '1-install/mimic', '1-pg-log-overrides/short_pg_log', '1-ranks/1', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-partial-recovery}', '2-services/basic', '2-services/mirror', '3-final}', '3-inline/yes', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_8.stream_container_tools', 'ceph', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'conf/{client', 'crc-failures/default', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'mds', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'openstack}', 'osd}', 'overrides/{pg-warn', 'rados', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-partial-recovery}', 'roles', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-from/v16.2.4', 'thrashers/careful', 'thrashers/default', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/cache-pool-snaps}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/redirect_set_object}', 'workloads/test_rbd_api}'] 2022-07-04T17:43:53.556 INFO:scrape: 2022-07-04T17:43:53.557 INFO:scrape:Failure: Command failed on smithi073 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:494bbf8c4cff5775f04a6a479335587c213bcf08 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9c5b143c-fb5f-11ec-842c-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-07-04T17:43:53.557 INFO:scrape:1 jobs: ['6911395'] 2022-07-04T17:43:53.558 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-07-04T17:43:53.558 INFO:scrape: 2022-07-04T17:43:53.559 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi036.front.sepia.ceph.com: ['type=AVC msg=audit(1656916748.396:6413): avc: denied { ioctl } for pid=59133 comm="iptables" path="/var/lib/containers/storage/overlay/fcc5cd0e1630aaf4ddefc0a2bc83706136fe12c5db62ff79c48bff026962752d/merged" dev="overlay" ino=3805307 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-07-04T17:43:53.559 INFO:scrape:3 jobs: ['6911425', '6911121', '6911216'] 2022-07-04T17:43:53.560 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-07-04T17:43:53.560 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-07-04T17:43:53.561 INFO:scrape: 2022-07-04T17:43:53.561 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2022-07-04T17:43:53.562 INFO:scrape:1 jobs: ['6911036'] 2022-07-04T17:43:53.562 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/rados_api_tests}'] 2022-07-04T17:43:53.563 INFO:scrape: 2022-07-04T17:43:53.563 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2022-07-04T17:43:53.564 INFO:scrape:2 jobs: ['6911106', '6911364'] 2022-07-04T17:43:53.564 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}'] 2022-07-04T17:43:53.564 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}'] 2022-07-04T17:43:53.565 INFO:scrape: 2022-07-04T17:43:53.565 INFO:scrape:Failure: {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-04T17:43:53.566 INFO:scrape:6 jobs: ['6911113', '6911241', '6911185', '6911262', '6911169', '6911107'] 2022-07-04T17:43:53.566 INFO:scrape:suites intersection: [] 2022-07-04T17:43:53.567 INFO:scrape:suites union: ['0-nvme-loop', '1-pg-log-overrides/short_pg_log', '1-start', '2-recovery-overrides/{more-active-recovery}', '2-services/nfs-ingress-rgw-user', '3-final}', '3-scrub-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/default', 'd-balancer/crush-compat', 'debug/mgr', 'fast/fast', 'fixed-2', 'mgr_ttl_cache/enable', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'start', 'supported-random-distro$/{rhel_8}', 'tasks/progress}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/default', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects}'] 2022-07-04T17:43:53.567 INFO:scrape: 2022-07-04T17:43:53.568 INFO:scrape:Failure: Command failed on smithi131 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7991c9de-fb5d-11ec-842c-001a4aab830c -- ceph orch ls -f json' 2022-07-04T17:43:53.568 INFO:scrape:6 jobs: ['6911370', '6911061', '6911089', '6911300', '6911439', '6911231'] 2022-07-04T17:43:53.569 INFO:scrape:suites intersection: ['3-upgrade-with-workload'] 2022-07-04T17:43:53.569 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-ranks/1', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-nfs', '3-inline/yes', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-07-04T17:43:53.570 INFO:scrape: 2022-07-04T17:43:53.570 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi156.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-07-04T17:43:53.571 INFO:scrape:1 jobs: ['6911234'] 2022-07-04T17:43:53.571 INFO:scrape:suites: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-07-04T17:43:53.572 INFO:scrape: 2022-07-04T17:43:53.572 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2022-07-04T17:43:53.573 INFO:scrape:1 jobs: ['6911152'] 2022-07-04T17:43:53.573 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-07-04T17:43:53.574 INFO:scrape: 2022-07-04T17:43:53.574 INFO:scrape:Dead: b'2022-07-04T16:46:53.688 DEBUG:teuthology.exit:Finished running handlers' 2022-07-04T17:43:53.575 INFO:scrape:2 jobs: ['6911251', '6911352'] 2022-07-04T17:43:53.575 INFO:scrape:suites intersection: [] 2022-07-04T17:43:53.575 INFO:scrape:suites union: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'ceph', 'clusters/{fixed-2', 'conf/{client', 'fast/normal', 'mds', 'mon', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'openstack}', 'osd}', 'overrides/{pg-warn', 'rados', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{more-async-recovery}', 'roles', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-from/v16.2.4', 'thrashers/minsize_recovery', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/ec-pool-snaps-few-objects-overwrites}'] 2022-07-04T17:43:53.576 INFO:scrape: 2022-07-04T17:43:53.576 INFO:scrape:Failure: Command failed (workunit test rest/test-restful.sh) on smithi050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.a/client.a/tmp && cd -- /home/ubuntu/cephtest/mnt.a/client.a/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=494bbf8c4cff5775f04a6a479335587c213bcf08 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="a" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.a CEPH_ROOT=/home/ubuntu/cephtest/clone.client.a CEPH_MNT=/home/ubuntu/cephtest/mnt.a adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.a/qa/workunits/rest/test-restful.sh' 2022-07-04T17:43:53.577 INFO:scrape:1 jobs: ['6911283'] 2022-07-04T17:43:53.577 INFO:scrape:suites: ['rados/rest/{mgr-restful', 'supported-random-distro$/{ubuntu_latest}}'] 2022-07-04T17:43:53.578 INFO:scrape: 2022-07-04T17:43:53.578 INFO:scrape:Failure: Test failure: test_telemetry (tasks.mgr.test_module_selftest.TestModuleSelftest) 2022-07-04T17:43:53.579 INFO:scrape:1 jobs: ['6911143'] 2022-07-04T17:43:53.579 INFO:scrape:suites: ['debug/mgr', 'mgr_ttl_cache/disable', 'mon_election/classic', 'objectstore/bluestore-bitmap', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{rhel_8}', 'tasks/module_selftest}'] 2022-07-04T17:43:53.580 INFO:scrape: 2022-07-04T17:43:53.593 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/ failed: 25 dead: 8 running: 0 waiting: 0 queued: 0 passed: 380 Fail ================================================================= [6911036] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 03:19:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911036/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911036/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5a742daa7054e8d8f5d7b337299f94d Command failed (workunit test rados/test.sh) on smithi110 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=494bbf8c4cff5775f04a6a479335587c213bcf08 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6911061] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911061/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911061/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4daa7bdaa2b84bd48bc1b4068d970e95 Command failed on smithi044 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b2e9384-fb3c-11ec-842c-001a4aab830c -- ceph osd crush tunables default' [6911089] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911089/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911089/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75db348d3fef4574a90b7679e0853af6 Command failed on smithi066 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80c6ddb4-fb41-11ec-842c-001a4aab830c -e sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6911106] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911106/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c6a0b5f3bc9408da9f04f8a5da6bf51 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6911121] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911121/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911121/ SELinux denials found on ubuntu@smithi185.front.sepia.ceph.com: ['type=AVC msg=audit(1656905630.990:6417): avc: denied { ioctl } for pid=59167 comm="iptables" path="/var/lib/containers/storage/overlay/0839b39063b43decf 0b8412d46828eb824a8671893b274c1630639f02fa35aeb/merged" dev="overlay" ino=3805284 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1656905631.024:6418): avc: denied { ioctl } for pid=59172 comm="iptables" path="/var/lib/containers/storage/ov erlay/0839b39063b43decf0b8412d46828eb824a8671893b274c1630639f02fa35aeb/merg ed" dev="overlay" ino=3805284 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6911143] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:29:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911143/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911143/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6911f8f237d745fca7c74edc9f406a42 Test failure: test_telemetry (tasks.mgr.test_module_selftest.TestModuleSelftest) [6911152] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:31:11 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911152/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911152/ sentry: https://sentry.ceph.com/organizations/ceph/?query=35af239a4cea4dae991db0ceffb89841 Command failed (workunit test rados/test.sh) on smithi111 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=494bbf8c4cff5775f04a6a479335587c213bcf08 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6911216] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911216/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911216/ SELinux denials found on ubuntu@smithi001.front.sepia.ceph.com: ['type=AVC msg=audit(1656909521.995:6419): avc: denied { ioctl } for pid=59008 comm="iptables" path="/var/lib/containers/storage/overlay/1d23e2e23c06af1c1 237a954cdbc46663b6bad9102d366313d647f100f3ddc8d/merged" dev="overlay" ino=3805314 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6911231] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911231/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=667ea6eac7254e62a3b0037c90717ee8 Command failed on smithi174 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d965324-fb53-11ec-842c-001a4aab830c -e sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6911234] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:04:56 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911234/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d5680da8f294d7eb57b07e8a5405c55 [Errno 2] Cannot find file on the remote 'ubuntu@smithi156.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6911264] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911264/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911264/ Command failed on smithi162 with status 123: "sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if- empty -- gzip --" [6911283] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911283/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911283/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff3d76a51dbc43d391b96348bc211166 Command failed (workunit test rest/test-restful.sh) on smithi050 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.a/client.a/tmp && cd -- /home/ubuntu/cephtest/mnt.a/client.a/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=494bbf8c4cff5775f04a6a479335587c213bcf08 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="a" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.a CEPH_ROOT=/home/ubuntu/cephtest/clone.client.a CEPH_MNT=/home/ubuntu/cephtest/mnt.a adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.a/qa/workunits/rest/test-restful.sh' [6911298] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:18:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911298/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911298/ Command failed on smithi026 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" [6911300] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911300/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911300/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c77e01d30bc46199e163cd1c2cb2d75 Command failed on smithi047 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e62fbba6-fb57-11ec-842c-001a4aab830c -e sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6911336] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911336/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911336/ Command failed on smithi026 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" [6911361] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:13:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911361/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911361/ Command failed on smithi026 with status 123: "sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if- empty -- gzip --" [6911364] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:19:24 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911364/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911364/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0884169973364c5ba7fe299c5643c0ed 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6911369] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911369/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911369/ Command failed on smithi162 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" [6911370] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911370/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911370/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eff2ffa5386040858c98d884e5667191 Command failed on smithi131 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7991c9de- fb5d-11ec-842c-001a4aab830c -- ceph orch ls -f json' [6911392] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:32:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911392/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911392/ Command failed on smithi026 with status 123: "sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if- empty -- gzip --" [6911395] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911395/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911395/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc436b84816c4a7a9190f699c5da65f8 Command failed on smithi073 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:494bbf8c4cff5775f04a6a479335587c213bcf08 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9c5b143c-fb5f-11ec-842c-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6911398] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911398/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911398/ Command failed on smithi162 with status 123: "sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if- empty -- gzip --" [6911425] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911425/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911425/ SELinux denials found on ubuntu@smithi036.front.sepia.ceph.com: ['type=AVC msg=audit(1656916748.396:6413): avc: denied { ioctl } for pid=59133 comm="iptables" path="/var/lib/containers/storage/overlay/fcc5cd0e1630aaf4d defc0a2bc83706136fe12c5db62ff79c48bff026962752d/merged" dev="overlay" ino=3805307 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6911439] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911439/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5271b78d95374cfe83865bf5670e0159 Command failed on smithi050 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ade36868-fb63-11ec-842c-001a4aab830c -e sha1=494bbf8c4cff5775f04a6a479335587c213bcf08 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6911442] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911442/ Command failed on smithi162 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" Dead ================================================================= [6911107] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:03:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911107/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911107/ sentry: https://sentry.ceph.com/organizations/ceph/?query=223c124eb4874639b13b67f06b98b873 {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6911113] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:03:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911113/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911113/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b60e5174e3140369e3dd5925cc5f646 {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6911169] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:03:54 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911169/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f9eb3b2a1d943a4857924545ebfa4a9 {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6911185] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/progress} ----------------------------------------------------------------- time: 00:03:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911185/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911185/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ae73ce6b438413d8ceb1e1f0393a3f1 {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6911241] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:04:20 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911241/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911241/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ccd9a8eb1b248dca662623710df2bf3 {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6911251] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911251/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911251/ hit max job timeout [6911262] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911262/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911262/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d30899ab60e640c4acb60d09ab05dced {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6911352] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911352/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911352/ hit max job timeout Pass ================================================================= [6911033] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911033/ [6911034] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:04:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911034/ [6911035] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:48:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911035/ [6911037] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:07:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911037/ [6911038] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:20:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911038/ [6911039] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:18 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911039/ [6911040] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911040/ [6911041] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911041/ [6911042] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:26 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911042/ [6911043] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911043/ [6911044] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:31:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911044/ [6911045] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911045/ [6911046] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911046/ [6911047] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911047/ [6911048] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:28:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911048/ [6911049] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911049/ [6911050] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911050/ [6911051] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:41:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911051/ [6911052] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911052/ [6911053] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911053/ [6911054] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:43:14 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911054/ [6911055] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:16:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911055/ [6911056] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911056/ [6911057] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911057/ [6911058] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:23 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911058/ [6911059] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911059/ [6911060] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911060/ [6911062] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911062/ [6911063] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/failover} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911063/ [6911064] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911064/ [6911065] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:28:50 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911065/ [6911066] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:23:32 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911066/ [6911067] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911067/ [6911068] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:34:56 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911068/ [6911069] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 02:08:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911069/ [6911070] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911070/ [6911071] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911071/ [6911072] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:43:14 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911072/ [6911073] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:20:08 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911073/ [6911074] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911074/ [6911075] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:11:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911075/ [6911076] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911076/ [6911077] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:00:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911077/ [6911078] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911078/ [6911079] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911079/ [6911080] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:10 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911080/ [6911081] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911081/ [6911082] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911082/ [6911083] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911083/ [6911084] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911084/ [6911085] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:19:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911085/ [6911086] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911086/ [6911087] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911087/ [6911088] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911088/ [6911090] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911090/ [6911091] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911091/ [6911092] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr orchestrator_cli} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911092/ [6911093] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911093/ [6911094] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:23:20 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911094/ [6911095] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:16:54 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911095/ [6911096] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911096/ [6911097] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911097/ [6911098] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} time: 02:24:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911098/ [6911099] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911099/ [6911100] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/insights} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911100/ [6911101] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911101/ [6911102] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911102/ [6911103] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911103/ [6911104] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911104/ [6911105] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:28:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911105/ [6911108] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 00:43:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911108/ [6911109] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:34:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911109/ [6911110] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911110/ [6911111] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911111/ [6911112] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911112/ [6911114] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911114/ [6911115] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911115/ [6911116] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911116/ [6911117] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911117/ [6911118] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:24 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911118/ [6911119] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:32:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911119/ [6911120] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911120/ [6911122] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:33:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911122/ [6911123] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911123/ [6911124] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911124/ [6911125] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911125/ [6911126] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911126/ [6911127] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911127/ [6911128] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:49:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911128/ [6911129] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:04:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911129/ [6911130] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911130/ [6911131] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911131/ [6911132] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911132/ [6911133] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 01:11:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911133/ [6911134] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911134/ [6911135] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911135/ [6911136] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:04:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911136/ [6911137] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911137/ [6911138] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911138/ [6911139] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911139/ [6911140] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911140/ [6911141] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911141/ [6911142] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911142/ [6911144] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:31:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911144/ [6911145] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:28:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911145/ [6911146] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911146/ [6911147] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911147/ [6911148] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:48:26 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911148/ [6911149] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911149/ [6911150] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911150/ [6911151] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911151/ [6911153] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911153/ [6911154] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911154/ [6911155] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911155/ [6911156] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911156/ [6911157] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911157/ [6911158] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:23:20 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911158/ [6911159] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911159/ [6911160] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911160/ [6911161] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911161/ [6911162] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:22:50 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911162/ [6911163] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911163/ [6911164] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911164/ [6911165] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911165/ [6911166] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911166/ [6911167] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:09:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911167/ [6911168] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911168/ [6911170] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911170/ [6911171] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:45:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911171/ [6911172] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911172/ [6911173] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911173/ [6911174] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:34 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911174/ [6911175] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911175/ [6911176] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:28:15 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911176/ [6911177] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911177/ [6911178] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911178/ [6911179] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911179/ [6911180] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:21:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911180/ [6911181] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:56 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911181/ [6911182] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911182/ [6911183] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911183/ [6911184] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} time: 00:33:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911184/ [6911186] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911186/ [6911187] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911187/ [6911188] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:42:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911188/ [6911189] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911189/ [6911190] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911190/ [6911191] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911191/ [6911192] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911192/ [6911193] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911193/ [6911194] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911194/ [6911195] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:32:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911195/ [6911196] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:31:50 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911196/ [6911197] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911197/ [6911198] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911198/ [6911199] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911199/ [6911200] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911200/ [6911201] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911201/ [6911202] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911202/ [6911203] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911203/ [6911204] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911204/ [6911205] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911205/ [6911206] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:32 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911206/ [6911207] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:28:38 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911207/ [6911208] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911208/ [6911209] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:31:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911209/ [6911210] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911210/ [6911211] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:31:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911211/ [6911212] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911212/ [6911213] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911213/ [6911214] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911214/ [6911215] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911215/ [6911217] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911217/ [6911218] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911218/ [6911219] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911219/ [6911220] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911220/ [6911221] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:41:38 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911221/ [6911222] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/prometheus} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911222/ [6911223] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:30:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911223/ [6911224] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:23:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911224/ [6911225] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911225/ [6911226] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 01:40:14 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911226/ [6911227] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911227/ [6911228] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911228/ [6911229] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911229/ [6911230] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:34:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911230/ [6911232] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911232/ [6911233] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 02:09:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911233/ [6911235] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911235/ [6911236] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:08:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911236/ [6911237] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:04 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911237/ [6911238] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911238/ [6911239] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911239/ [6911240] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:45:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911240/ [6911242] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:05:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911242/ [6911243] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:35:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911243/ [6911244] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:57 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911244/ [6911245] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911245/ [6911246] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911246/ [6911247] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:26 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911247/ [6911248] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911248/ [6911249] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:55:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911249/ [6911250] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911250/ [6911252] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:48:27 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911252/ [6911253] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911253/ [6911254] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911254/ [6911255] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911255/ [6911256] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911256/ [6911257] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911257/ [6911258] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 01:08:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911258/ [6911259] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911259/ [6911260] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:41:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911260/ [6911261] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911261/ [6911263] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} time: 00:28:01 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911263/ [6911265] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/workunits} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911265/ [6911266] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911266/ [6911267] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:28:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911267/ [6911268] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911268/ [6911269] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:31:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911269/ [6911270] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911270/ [6911271] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:35:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911271/ [6911272] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911272/ [6911273] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911273/ [6911274] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:31:26 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911274/ [6911275] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:49:41 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911275/ [6911276] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911276/ [6911277] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:29:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911277/ [6911278] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911278/ [6911279] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911279/ [6911280] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911280/ [6911281] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:15:34 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911281/ [6911282] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911282/ [6911284] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911284/ [6911285] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911285/ [6911286] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:49:25 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911286/ [6911287] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911287/ [6911288] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911288/ [6911289] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911289/ [6911290] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911290/ [6911291] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911291/ [6911292] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:34 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911292/ [6911293] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:34:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911293/ [6911294] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:30:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911294/ [6911295] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 01:23:56 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911295/ [6911296] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911296/ [6911297] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911297/ [6911299] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911299/ [6911301] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911301/ [6911302] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911302/ [6911303] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911303/ [6911304] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911304/ [6911305] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911305/ [6911306] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911306/ [6911307] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/crash} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911307/ [6911308] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:28:04 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911308/ [6911309] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:33:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911309/ [6911310] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911310/ [6911311] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911311/ [6911312] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911312/ [6911313] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911313/ [6911314] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911314/ [6911315] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911315/ [6911316] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:52:25 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911316/ [6911317] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:50:06 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911317/ [6911318] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911318/ [6911319] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:03 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911319/ [6911320] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911320/ [6911321] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911321/ [6911322] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911322/ [6911323] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911323/ [6911324] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911324/ [6911325] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:41:34 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911325/ [6911326] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:20:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911326/ [6911327] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911327/ [6911328] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911328/ [6911329] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911329/ [6911330] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911330/ [6911331] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911331/ [6911332] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:31:57 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911332/ [6911333] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911333/ [6911334] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:10 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911334/ [6911335] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:18 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911335/ [6911337] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911337/ [6911338] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911338/ [6911339] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:17:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911339/ [6911340] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911340/ [6911341] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:08:08 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911341/ [6911342] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:04:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911342/ [6911343] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911343/ [6911344] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:20:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911344/ [6911345] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:38:27 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911345/ [6911346] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:33:02 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911346/ [6911347] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911347/ [6911348] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/failover} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911348/ [6911349] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} time: 00:34:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911349/ [6911350] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911350/ [6911351] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911351/ [6911353] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911353/ [6911354] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:39:05 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911354/ [6911355] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911355/ [6911356] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911356/ [6911357] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:10 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911357/ [6911358] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:07 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911358/ [6911359] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911359/ [6911360] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911360/ [6911362] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911362/ [6911363] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911363/ [6911365] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:08:27 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911365/ [6911366] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911366/ [6911367] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:50:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911367/ [6911368] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:24:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911368/ [6911371] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911371/ [6911372] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911372/ [6911373] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911373/ [6911374] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911374/ [6911375] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911375/ [6911376] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911376/ [6911377] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:48:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911377/ [6911378] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911378/ [6911379] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:35:22 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911379/ [6911380] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911380/ [6911381] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911381/ [6911382] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911382/ [6911383] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:42:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911383/ [6911384] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911384/ [6911385] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911385/ [6911386] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:45:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911386/ [6911387] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911387/ [6911388] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911388/ [6911389] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911389/ [6911390] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911390/ [6911391] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911391/ [6911393] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911393/ [6911394] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911394/ [6911396] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911396/ [6911397] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:17:01 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911397/ [6911399] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:59:39 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911399/ [6911400] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911400/ [6911401] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911401/ [6911402] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911402/ [6911403] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911403/ [6911404] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911404/ [6911405] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:03 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911405/ [6911406] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911406/ [6911407] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911407/ [6911408] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911408/ [6911409] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:32:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911409/ [6911410] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911410/ [6911411] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911411/ [6911412] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911412/ [6911413] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911413/ [6911414] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:26 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911414/ [6911415] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911415/ [6911416] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:31:41 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911416/ [6911417] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911417/ [6911418] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:36:02 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911418/ [6911419] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911419/ [6911420] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911420/ [6911421] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911421/ [6911422] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911422/ [6911423] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:16:48 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911423/ [6911424] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:33 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911424/ [6911426] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911426/ [6911427] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911427/ [6911428] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911428/ [6911429] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911429/ [6911430] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:32:29 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911430/ [6911431] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911431/ [6911432] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 02:26:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911432/ [6911433] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911433/ [6911434] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:46 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911434/ [6911435] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:34:01 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911435/ [6911436] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:14 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911436/ [6911437] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:31:35 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911437/ [6911438] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911438/ [6911440] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:09:23 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911440/ [6911441] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911441/ [6911443] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911443/ [6911444] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911444/ [6911445] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:04:44 info: http://pulpito.ceph.com/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911445/