2022-03-13T03:34:16.387 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-13T03:34:16.391 INFO:teuthology.results:subset: '1325/99999' 2022-03-13T03:34:16.391 INFO:teuthology.results:seed: '8770' 2022-03-13T07:52:08.729 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-13T07:52:08.766 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-13T14:20:47.459 INFO:teuthology.results:Tests finished! gathering results... 2022-03-13T14:21:17.666 INFO:scrape:Found 413 jobs 2022-03-13T14:21:19.059 INFO:scrape:Found 8 distinct failure reasons 2022-03-13T14:21:19.060 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi065.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-03-13T14:21:19.061 INFO:scrape:2 jobs: ['6734104', '6734359'] 2022-03-13T14:21:19.061 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/master}'] 2022-03-13T14:21:19.062 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/master}'] 2022-03-13T14:21:19.062 INFO:scrape: 2022-03-13T14:21:19.063 INFO:scrape:Failure: SSH connection to smithi067 was lost: 'uname -r' 2022-03-13T14:21:19.063 INFO:scrape:3 jobs: ['6734114', '6734084', '6734259'] 2022-03-13T14:21:19.063 INFO:scrape:suites intersection: ['thrashosds-health'] 2022-03-13T14:21:19.064 INFO:scrape:suites union: ['1-install/mimic', '1-install/nautilus', '1-install/nautilus-v1only', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-pacific', '8-workload/{rbd-python', 'backoff/normal', 'backoff/peering', 'bluestore-bitmap', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashers/careful', 'thrashers/default', 'thrashosds-health', 'three-plus-one}', 'ubuntu_18.04}', 'workloads/rbd_cls}', 'workloads/test_rbd_api}'] 2022-03-13T14:21:19.064 INFO:scrape: 2022-03-13T14:21:19.065 INFO:scrape:Failure: Command failed on smithi178 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ae5a674e370fd9fc53984667ce1643eee808b65a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e0bfadc-a2a2-11ec-8c35-001a4aab830c -- ceph mon dump -f json' 2022-03-13T14:21:19.065 INFO:scrape:2 jobs: ['6734360', '6734196'] 2022-03-13T14:21:19.066 INFO:scrape:suites intersection: [] 2022-03-13T14:21:19.066 INFO:scrape:suites union: ['0-nvme-loop', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-ops/rm-zap-wait}', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-03-13T14:21:19.066 INFO:scrape: 2022-03-13T14:21:19.067 INFO:scrape:Dead: b'2022-03-13T10:53:08.972 DEBUG:teuthology.exit:Finished running handlers' 2022-03-13T14:21:19.067 INFO:scrape:8 jobs: ['6734042', '6734302', '6734029', '6734089', '6734376', '6734236', '6734099', '6733991'] 2022-03-13T14:21:19.068 INFO:scrape:suites intersection: [] 2022-03-13T14:21:19.068 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-start', '2-nfs', '2-ops/rm-zap-flag}', '3-upgrade-with-workload', '4-final}', 'ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'd-thrash/none', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'rados/verify/{centos_latest', 'start', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'thrashosds-health}', 'validater/lockdep}', 'validater/valgrind}'] 2022-03-13T14:21:19.069 INFO:scrape: 2022-03-13T14:21:19.069 INFO:scrape:Failure: Command failed on smithi014 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2022-03-13T14:21:19.069 INFO:scrape:1 jobs: ['6734288'] 2022-03-13T14:21:19.070 INFO:scrape:suites: ['clusters/{2-node-mgr}', 'debug/mgr', 'mon_election/connectivity', 'rados/dashboard/{centos_8.stream_container_tools', 'random-objectstore$/{bluestore-bitmap}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2022-03-13T14:21:19.070 INFO:scrape: 2022-03-13T14:21:19.071 INFO:scrape:Failure: timeout expired in wait_until_healthy 2022-03-13T14:21:19.071 INFO:scrape:1 jobs: ['6734195'] 2022-03-13T14:21:19.071 INFO:scrape:suites: ['fixed-2', 'mode/root', 'mon_election/classic', 'msgr/async-v1only', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'start', 'tasks/rados_python}'] 2022-03-13T14:21:19.072 INFO:scrape: 2022-03-13T14:21:19.072 INFO:scrape:Failure: Command failed on smithi025 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid df7038d0-a293-11ec-8c35-001a4aab830c -- bash -c 'ceph nfs export create cephfs --fsname foofs --clusterid foo --binding /fake || ceph nfs export create cephfs --fsname foofs --cluster-id foo --pseudo-path /fake'" 2022-03-13T14:21:19.073 INFO:scrape:1 jobs: ['6734171'] 2022-03-13T14:21:19.073 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-03-13T14:21:19.073 INFO:scrape: 2022-03-13T14:21:19.074 INFO:scrape:Failure: Command failed on smithi107 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ae5a674e370fd9fc53984667ce1643eee808b65a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bc556e46-a294-11ec-8c35-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-03-13T14:21:19.074 INFO:scrape:1 jobs: ['6734187'] 2022-03-13T14:21:19.075 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-03-13T14:21:19.075 INFO:scrape: 2022-03-13T14:21:19.087 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/ failed: 8 dead: 11 running: 0 waiting: 0 queued: 0 passed: 394 Fail ================================================================= [6734104] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734104/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734104/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5397b9826f2452680a96411d2fdb133 [Errno 2] Cannot find file on the remote 'ubuntu@smithi065.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6734171] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734171/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df506ee780c443629f5e21cf3b7aa496 Command failed on smithi025 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid df7038d0-a293-11ec-8c35-001a4aab830c -- bash -c 'ceph nfs export create cephfs --fsname foofs --clusterid foo --binding /fake || ceph nfs export create cephfs --fsname foofs --cluster-id foo --pseudo-path /fake'" [6734187] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:13:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734187/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd366d541b634fb4b5022cc8574f939c Command failed on smithi107 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:ae5a674e370fd9fc53984667ce1643eee808b65a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bc556e46-a294-11ec-8c35-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6734195] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:34:32 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734195/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47b71357b6074a579e1e014f1287090c timeout expired in wait_until_healthy [6734196] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734196/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0612e5c6ccd64488ba49a316439a0cd7 Command failed on smithi057 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0e348dc-a295-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_2' [6734288] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:03:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734288/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734288/ sentry: https://sentry.ceph.com/organizations/ceph/?query=deea6c00a5ec41cb8b2272014d3678aa Command failed on smithi014 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6734359] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734359/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734359/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d362f33ca71543adaff7383322dc7927 [Errno 2] Cannot find file on the remote 'ubuntu@smithi141.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6734360] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734360/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734360/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d377284f6a044e6a12339070b5a42f5 Command failed on smithi178 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:ae5a674e370fd9fc53984667ce1643eee808b65a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e0bfadc-a2a2-11ec-8c35-001a4aab830c -- ceph mon dump -f json' Dead ================================================================= [6733991] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733991/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733991/ hit max job timeout [6734029] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734029/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734029/ hit max job timeout [6734042] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734042/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734042/ hit max job timeout [6734084] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734084/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734084/ sentry: https://sentry.ceph.com/organizations/ceph/?query=558fea85dd6c4778ac691b772a19702a SSH connection to smithi155 was lost: 'uname -r' [6734089] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734089/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734089/ hit max job timeout [6734099] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734099/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734099/ hit max job timeout [6734114] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734114/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eaa75be00e124acf8a20447a876c1aac SSH connection to smithi067 was lost: 'uname -r' [6734236] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734236/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734236/ hit max job timeout [6734259] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734259/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5ad740675cc465ea1912cd145b347fa SSH connection to smithi150 was lost: 'uname -r' [6734302] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734302/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734302/ hit max job timeout [6734376] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734376/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734376/ hit max job timeout Pass ================================================================= [6733985] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733985/ [6733986] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733986/ [6733987] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:40:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733987/ [6733988] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733988/ [6733989] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733989/ [6733990] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:34:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733990/ [6733992] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733992/ [6733993] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733993/ [6733994] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733994/ [6733995] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733995/ [6733996] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733996/ [6733997] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733997/ [6733998] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733998/ [6733999] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/insights} time: 00:25:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6733999/ [6734000] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:17:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734000/ [6734001] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734001/ [6734002] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:39:30 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734002/ [6734003] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734003/ [6734004] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:07:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734004/ [6734005] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734005/ [6734006] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734006/ [6734007] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734007/ [6734008] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734008/ [6734009] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734009/ [6734010] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:47:25 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734010/ [6734011] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734011/ [6734012] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734012/ [6734013] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734013/ [6734014] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734014/ [6734015] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:25:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734015/ [6734016] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734016/ [6734017] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:19:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734017/ [6734018] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734018/ [6734019] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:29:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734019/ [6734020] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734020/ [6734021] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:24:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734021/ [6734022] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:28:27 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734022/ [6734023] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:51:20 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734023/ [6734024] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 01:07:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734024/ [6734025] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734025/ [6734026] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:45:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734026/ [6734027] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734027/ [6734028] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734028/ [6734030] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:35:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734030/ [6734031] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734031/ [6734032] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734032/ [6734033] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 01:15:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734033/ [6734034] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734034/ [6734035] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 04:56:18 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734035/ [6734036] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734036/ [6734037] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:15 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734037/ [6734038] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:30 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734038/ [6734039] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:42:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734039/ [6734040] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734040/ [6734041] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734041/ [6734043] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734043/ [6734044] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:24:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734044/ [6734045] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734045/ [6734046] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734046/ [6734047] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734047/ [6734048] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734048/ [6734049] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734049/ [6734050] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734050/ [6734051] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734051/ [6734052] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734052/ [6734053] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734053/ [6734054] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:35:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734054/ [6734055] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 01:26:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734055/ [6734056] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734056/ [6734057] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:42:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734057/ [6734058] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:34:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734058/ [6734059] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734059/ [6734060] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734060/ [6734061] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734061/ [6734062] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734062/ [6734063] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734063/ [6734064] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} time: 00:24:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734064/ [6734065] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:16:20 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734065/ [6734066] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734066/ [6734067] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734067/ [6734068] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734068/ [6734069] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734069/ [6734070] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734070/ [6734071] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734071/ [6734072] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:16 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734072/ [6734073] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734073/ [6734074] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734074/ [6734075] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734075/ [6734076] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 02:19:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734076/ [6734077] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:14:06 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734077/ [6734078] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734078/ [6734079] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734079/ [6734080] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734080/ [6734081] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734081/ [6734082] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734082/ [6734083] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734083/ [6734085] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734085/ [6734086] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734086/ [6734087] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:54 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734087/ [6734088] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:39:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734088/ [6734090] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:31:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734090/ [6734091] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:24:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734091/ [6734092] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:36:19 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734092/ [6734093] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:14:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734093/ [6734094] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734094/ [6734095] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734095/ [6734096] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734096/ [6734097] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734097/ [6734098] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734098/ [6734100] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:23:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734100/ [6734101] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr orchestrator_cli} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734101/ [6734102] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734102/ [6734103] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:36:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734103/ [6734105] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734105/ [6734106] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734106/ [6734107] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734107/ [6734108] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734108/ [6734109] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734109/ [6734110] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 01:02:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734110/ [6734111] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:28:03 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734111/ [6734112] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734112/ [6734113] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734113/ [6734115] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734115/ [6734116] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734116/ [6734117] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:37:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734117/ [6734118] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734118/ [6734119] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:09 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734119/ [6734120] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734120/ [6734121] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734121/ [6734122] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734122/ [6734123] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734123/ [6734124] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734124/ [6734125] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734125/ [6734126] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734126/ [6734127] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} time: 02:09:19 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734127/ [6734128] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:24:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734128/ [6734129] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734129/ [6734130] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:26:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734130/ [6734131] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734131/ [6734132] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:45:03 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734132/ [6734133] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects} time: 00:21:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734133/ [6734134] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:48:08 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734134/ [6734135] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734135/ [6734136] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734136/ [6734137] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734137/ [6734138] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:44:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734138/ [6734139] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734139/ [6734140] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734140/ [6734141] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734141/ [6734142] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:41:27 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734142/ [6734143] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:06 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734143/ [6734144] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:32:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734144/ [6734145] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734145/ [6734146] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734146/ [6734147] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734147/ [6734148] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734148/ [6734149] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} time: 00:40:28 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734149/ [6734150] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734150/ [6734151] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734151/ [6734152] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:38:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734152/ [6734153] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734153/ [6734154] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734154/ [6734155] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734155/ [6734156] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734156/ [6734157] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:32:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734157/ [6734158] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:17:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734158/ [6734159] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734159/ [6734160] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734160/ [6734161] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734161/ [6734162] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:25:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734162/ [6734163] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:45:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734163/ [6734164] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/workunits} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734164/ [6734165] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734165/ [6734166] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734166/ [6734167] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:30:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734167/ [6734168] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734168/ [6734169] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734169/ [6734170] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:32:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734170/ [6734172] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734172/ [6734173] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:42:44 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734173/ [6734174] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:38:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734174/ [6734175] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734175/ [6734176] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734176/ [6734177] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:25:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734177/ [6734178] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734178/ [6734179] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734179/ [6734180] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734180/ [6734181] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734181/ [6734182] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734182/ [6734183] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734183/ [6734184] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734184/ [6734185] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734185/ [6734186] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734186/ [6734188] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/many workloads/snaps-few-objects} time: 00:51:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734188/ [6734189] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734189/ [6734190] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:01:11 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734190/ [6734191] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734191/ [6734192] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:45 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734192/ [6734193] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734193/ [6734194] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:35:24 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734194/ [6734197] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734197/ [6734198] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734198/ [6734199] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734199/ [6734200] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734200/ [6734201] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734201/ [6734202] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/crash} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734202/ [6734203] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734203/ [6734204] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734204/ [6734205] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:25:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734205/ [6734206] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734206/ [6734207] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734207/ [6734208] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 01:03:03 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734208/ [6734209] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:09:52 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734209/ [6734210] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734210/ [6734211] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734211/ [6734212] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734212/ [6734213] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734213/ [6734214] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:36:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734214/ [6734215] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734215/ [6734216] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734216/ [6734217] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:27:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734217/ [6734218] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734218/ [6734219] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:24:36 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734219/ [6734220] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:16:03 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734220/ [6734221] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734221/ [6734222] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734222/ [6734223] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734223/ [6734224] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734224/ [6734225] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:25:36 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734225/ [6734226] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734226/ [6734227] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734227/ [6734228] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734228/ [6734229] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734229/ [6734230] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:33:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734230/ [6734231] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:32:08 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734231/ [6734232] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} time: 00:31:11 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734232/ [6734233] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734233/ [6734234] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:47:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734234/ [6734235] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:23:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734235/ [6734237] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:43:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734237/ [6734238] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:30:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734238/ [6734239] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734239/ [6734240] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:20:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734240/ [6734241] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734241/ [6734242] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:34 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734242/ [6734243] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:06:16 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734243/ [6734244] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/failover} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734244/ [6734245] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:26:52 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734245/ [6734246] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734246/ [6734247] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734247/ [6734248] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734248/ [6734249] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734249/ [6734250] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734250/ [6734251] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734251/ [6734252] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734252/ [6734253] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734253/ [6734254] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734254/ [6734255] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734255/ [6734256] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 01:03:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734256/ [6734257] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734257/ [6734258] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:31:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734258/ [6734260] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:40:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734260/ [6734261] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:30:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734261/ [6734262] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734262/ [6734263] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734263/ [6734264] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734264/ [6734265] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734265/ [6734266] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734266/ [6734267] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:09:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734267/ [6734268] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:51:36 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734268/ [6734269] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734269/ [6734270] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:25:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734270/ [6734271] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734271/ [6734272] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734272/ [6734273] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734273/ [6734274] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734274/ [6734275] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734275/ [6734276] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734276/ [6734277] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734277/ [6734278] rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734278/ [6734279] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734279/ [6734280] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734280/ [6734281] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734281/ [6734282] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734282/ [6734283] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:37:16 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734283/ [6734284] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:38:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734284/ [6734285] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/insights} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734285/ [6734286] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734286/ [6734287] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734287/ [6734289] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:29:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734289/ [6734290] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:02:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734290/ [6734291] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734291/ [6734292] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} time: 00:30:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734292/ [6734293] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:34 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734293/ [6734294] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:29:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734294/ [6734295] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:36:36 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734295/ [6734296] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734296/ [6734297] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734297/ [6734298] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 01:55:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734298/ [6734299] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734299/ [6734300] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:45 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734300/ [6734301] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734301/ [6734303] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734303/ [6734304] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734304/ [6734305] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734305/ [6734306] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734306/ [6734307] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734307/ [6734308] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734308/ [6734309] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 01:28:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734309/ [6734310] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:12:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734310/ [6734311] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734311/ [6734312] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:05:43 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734312/ [6734313] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734313/ [6734314] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:54 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734314/ [6734315] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:24:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734315/ [6734316] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734316/ [6734317] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:37:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734317/ [6734318] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:46:01 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734318/ [6734319] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:43:54 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734319/ [6734320] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:41:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734320/ [6734321] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734321/ [6734322] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:08 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734322/ [6734323] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734323/ [6734324] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734324/ [6734325] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734325/ [6734326] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734326/ [6734327] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734327/ [6734328] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734328/ [6734329] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734329/ [6734330] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:18:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734330/ [6734331] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734331/ [6734332] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734332/ [6734333] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734333/ [6734334] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:34:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734334/ [6734335] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734335/ [6734336] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734336/ [6734337] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734337/ [6734338] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:20:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734338/ [6734339] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734339/ [6734340] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734340/ [6734341] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:34:09 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734341/ [6734342] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:21:50 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734342/ [6734343] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734343/ [6734344] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:42 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734344/ [6734345] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734345/ [6734346] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734346/ [6734347] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:25:32 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734347/ [6734348] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734348/ [6734349] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734349/ [6734350] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:19:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734350/ [6734351] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:45:07 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734351/ [6734352] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734352/ [6734353] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734353/ [6734354] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734354/ [6734355] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734355/ [6734356] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734356/ [6734357] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734357/ [6734358] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734358/ [6734361] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734361/ [6734362] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734362/ [6734363] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:16:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734363/ [6734364] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734364/ [6734365] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734365/ [6734366] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734366/ [6734367] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734367/ [6734368] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734368/ [6734369] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/progress} time: 00:30:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734369/ [6734370] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734370/ [6734371] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734371/ [6734372] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} time: 02:16:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734372/ [6734373] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:32:46 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734373/ [6734374] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734374/ [6734375] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734375/ [6734377] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:40:48 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734377/ [6734378] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734378/ [6734379] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:23:23 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734379/ [6734380] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:19:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734380/ [6734381] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734381/ [6734382] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:26:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734382/ [6734383] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:33:06 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734383/ [6734384] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734384/ [6734385] rados/singleton/{all/deduptool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734385/ [6734386] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:08 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734386/ [6734387] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734387/ [6734388] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734388/ [6734389] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734389/ [6734390] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734390/ [6734391] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734391/ [6734392] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:04 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734392/ [6734393] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734393/ [6734394] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734394/ [6734395] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:14 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734395/ [6734396] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:47:45 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734396/ [6734397] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:37:33 info: http://pulpito.ceph.com/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734397/