2021-10-31T03:32:45.898 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-31T03:32:45.900 INFO:teuthology.results:subset: '4678/99999' 2021-10-31T03:32:45.900 INFO:teuthology.results:seed: '3441' 2021-10-31T06:27:48.277 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-31T06:27:48.318 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-31T17:02:43.304 INFO:teuthology.results:Tests finished! gathering results... 2021-10-31T17:03:23.260 INFO:scrape:Found 381 jobs 2021-10-31T17:03:26.087 INFO:scrape:Found 9 distinct failure reasons 2021-10-31T17:03:26.088 INFO:scrape:Dead: b'2021-10-31T16:58:42.473 DEBUG:teuthology.exit:Finished running handlers' 2021-10-31T17:03:26.089 INFO:scrape:2 jobs: ['6469481', '6469378'] 2021-10-31T17:03:26.089 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'mon_election/classic', 'openstack}', 'rados', 'thrashosds-health'] 2021-10-31T17:03:26.090 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'fast/normal', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-snaps-few-objects-overwrites}'] 2021-10-31T17:03:26.090 INFO:scrape: 2021-10-31T17:03:26.091 INFO:scrape:Failure: Command failed on smithi059 with status 1: 'sudo kubeadm init --node-name smithi059 --token abcdef.c84y59prf78m0ngf --pod-network-cidr 10.249.208.0/21' 2021-10-31T17:03:26.091 INFO:scrape:4 jobs: ['6469309', '6469667', '6469428', '6469549'] 2021-10-31T17:03:26.092 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico'] 2021-10-31T17:03:26.092 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}', 'rook/master}'] 2021-10-31T17:03:26.093 INFO:scrape: 2021-10-31T17:03:26.093 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi171 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-10-31T17:03:26.094 INFO:scrape:1 jobs: ['6469296'] 2021-10-31T17:03:26.094 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/filestore-xfs', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'workloads/rados_api_tests}'] 2021-10-31T17:03:26.095 INFO:scrape: 2021-10-31T17:03:26.096 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-10-31T17:03:26.097 INFO:scrape:1 jobs: ['6469528'] 2021-10-31T17:03:26.098 INFO:scrape:suites: ['rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0', 'task/test_e2e}'] 2021-10-31T17:03:26.099 INFO:scrape: 2021-10-31T17:03:26.099 INFO:scrape:Failure: Command failed (workunit test mon/crush_ops.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' 2021-10-31T17:03:26.100 INFO:scrape:1 jobs: ['6469373'] 2021-10-31T17:03:26.100 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/one', 'workloads/rados_mon_workunits}'] 2021-10-31T17:03:26.101 INFO:scrape: 2021-10-31T17:03:26.101 INFO:scrape:Failure: "2021-10-31T05:16:45.193827+0000 mon.a (mon.0) 30 : cluster [WRN] Health check update: 1/6 mons down, quorum a,b,c,e,f (MON_DOWN)" in cluster log 2021-10-31T17:03:26.102 INFO:scrape:1 jobs: ['6469501'] 2021-10-31T17:03:26.103 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'no_pools', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/multimon/{clusters/6', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_no_skews}'] 2021-10-31T17:03:26.103 INFO:scrape: 2021-10-31T17:03:26.104 INFO:scrape:Failure: Command failed on smithi190 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0572a128-3a05-11ec-8c28-001a4aab830c -- ceph mon dump -f json' 2021-10-31T17:03:26.105 INFO:scrape:2 jobs: ['6469437', '6469346'] 2021-10-31T17:03:26.105 INFO:scrape:suites intersection: ['fixed-2', 'rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0', 'start}'] 2021-10-31T17:03:26.106 INFO:scrape:suites union: ['fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0', 'start}'] 2021-10-31T17:03:26.106 INFO:scrape: 2021-10-31T17:03:26.107 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2021-10-31T17:03:26.108 INFO:scrape:1 jobs: ['6469362'] 2021-10-31T17:03:26.108 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_8}}'] 2021-10-31T17:03:26.109 INFO:scrape: 2021-10-31T17:03:26.109 INFO:scrape:Failure: Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2021-10-31T17:03:26.110 INFO:scrape:1 jobs: ['6469519'] 2021-10-31T17:03:26.110 INFO:scrape:suites: ['clusters/{2-node-mgr}', 'debug/mgr', 'mon_election/classic', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2021-10-31T17:03:26.111 INFO:scrape: 2021-10-31T17:03:26.128 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/ failed: 12 dead: 2 running: 0 waiting: 0 queued: 0 passed: 367 Fail ================================================================= [6469296] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:26:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469296/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469296/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f8b9f0eff63940c1940561ad82522d1b Command failed (workunit test rados/test.sh) on smithi171 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6469309] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469309/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469309/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08644761631c4a91b2f4622904d16a60 Command failed on smithi059 with status 1: 'sudo kubeadm init --node-name smithi059 --token abcdef.c84y59prf78m0ngf --pod-network-cidr 10.249.208.0/21' [6469346] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469346/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469346/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ba2e40a1888492baa7fd530ec47206c Command failed on smithi133 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9e4973c-39fd-11ec-8c28-001a4aab830c -- ceph mon dump -f json' [6469362] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:27:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469362/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469362/ Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6469373] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469373/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469373/ sentry: https://sentry.ceph.com/organizations/ceph/?query=660830d141dd4a2fb2dc5e2fc8da2663 Command failed (workunit test mon/crush_ops.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' [6469428] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469428/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469428/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a85af696837840c39e013345d339977a Command failed on smithi084 with status 1: 'sudo kubeadm init --node-name smithi084 --token abcdef.3vl8ts0varfqy6ib --pod-network-cidr 10.250.152.0/21' [6469437] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469437/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469437/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4d361e5d6344e209fb6d47aa643fd46 Command failed on smithi190 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0572a128-3a05-11ec-8c28-001a4aab830c -- ceph mon dump -f json' [6469501] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:06:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469501/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469501/ "2021-10-31T05:16:45.193827+0000 mon.a (mon.0) 30 : cluster [WRN] Health check update: 1/6 mons down, quorum a,b,c,e,f (MON_DOWN)" in cluster log [6469519] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:03:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469519/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc2a6027839d404f88864fe22e139031 Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6469528] rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469528/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7694a29a471c421b8320e7ca09318cc8 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4a6984d2b094e41a7fbbfa2acb694f7ec5d0603 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6469549] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469549/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469549/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66b0e81068c3478bbf6527e2b3d3862f Command failed on smithi016 with status 1: 'sudo kubeadm init --node-name smithi016 --token abcdef.ghqvnq1avut1k31v --pod-network-cidr 10.248.120.0/21' [6469667] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469667/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469667/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93ed7482a7504de5ac6cbc2a006e8873 Command failed on smithi172 with status 1: 'sudo kubeadm init --node-name smithi172 --token abcdef.msnnuurhxjbx3efe --pod-network-cidr 10.253.88.0/21' Dead ================================================================= [6469378] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469378/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469378/ hit max job timeout [6469481] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469481/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469481/ hit max job timeout Pass ================================================================= [6469289] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469289/ [6469290] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:38:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469290/ [6469291] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469291/ [6469292] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:24:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469292/ [6469293] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:51:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469293/ [6469294] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469294/ [6469295] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:48 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469295/ [6469297] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} time: 00:31:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469297/ [6469298] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 00:40:30 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469298/ [6469299] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469299/ [6469300] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/mirror 3-final} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469300/ [6469301] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469301/ [6469302] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469302/ [6469303] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469303/ [6469304] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:16:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469304/ [6469305] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:43:18 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469305/ [6469306] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:17:29 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469306/ [6469307] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:29:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469307/ [6469308] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469308/ [6469310] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469310/ [6469311] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:45:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469311/ [6469312] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:40:21 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469312/ [6469313] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress 3-final} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469313/ [6469314] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469314/ [6469315] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469315/ [6469316] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469316/ [6469317] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:32:56 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469317/ [6469318] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469318/ [6469319] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469319/ [6469320] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469320/ [6469321] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:25:38 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469321/ [6469322] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_write} time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469322/ [6469323] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:31 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469323/ [6469324] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress2 3-final} time: 00:23:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469324/ [6469325] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} time: 00:25:52 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469325/ [6469326] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:31:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469326/ [6469327] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469327/ [6469328] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:30:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469328/ [6469329] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469329/ [6469330] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:04 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469330/ [6469331] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:13:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469331/ [6469332] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:32:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469332/ [6469333] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:52:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469333/ [6469334] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469334/ [6469335] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469335/ [6469336] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs 3-final} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469336/ [6469337] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469337/ [6469338] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:56:31 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469338/ [6469339] rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0 task/test_e2e} time: 00:21:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469339/ [6469340] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469340/ [6469341] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469341/ [6469342] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469342/ [6469343] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:33:52 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469343/ [6469344] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469344/ [6469345] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469345/ [6469347] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_omap_write} time: 00:31:22 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469347/ [6469348] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469348/ [6469349] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469349/ [6469350] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469350/ [6469351] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469351/ [6469352] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:39:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469352/ [6469353] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469353/ [6469354] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469354/ [6469355] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469355/ [6469356] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:42:30 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469356/ [6469357] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:39:54 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469357/ [6469358] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/crash} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469358/ [6469359] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs2 3-final} time: 00:17:23 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469359/ [6469360] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469360/ [6469361] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:32:32 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469361/ [6469363] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:38:40 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469363/ [6469364] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} time: 02:28:38 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469364/ [6469365] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469365/ [6469366] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469366/ [6469367] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469367/ [6469368] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:23 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469368/ [6469369] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469369/ [6469370] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} time: 00:25:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469370/ [6469371] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw-ingress 3-final} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469371/ [6469372] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/sample_fio} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469372/ [6469374] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:37:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469374/ [6469375] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469375/ [6469376] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469376/ [6469377] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:44:54 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469377/ [6469379] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469379/ [6469380] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw 3-final} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469380/ [6469381] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469381/ [6469382] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469382/ [6469383] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:06:57 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469383/ [6469384] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469384/ [6469385] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/basic 3-final} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469385/ [6469386] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:35:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469386/ [6469387] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469387/ [6469388] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469388/ [6469389] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469389/ [6469390] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469390/ [6469391] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469391/ [6469392] rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469392/ [6469393] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:27:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469393/ [6469394] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/failover} time: 00:24:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469394/ [6469395] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} time: 00:28:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469395/ [6469396] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469396/ [6469397] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/sample_radosbench} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469397/ [6469398] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469398/ [6469399] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:22:32 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469399/ [6469400] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:53 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469400/ [6469401] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469401/ [6469402] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469402/ [6469403] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469403/ [6469404] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469404/ [6469405] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469405/ [6469406] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/client-keyring 3-final} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469406/ [6469407] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469407/ [6469408] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469408/ [6469409] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:54:33 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469409/ [6469410] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:32 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469410/ [6469411] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:06:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469411/ [6469412] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:27:17 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469412/ [6469413] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/iscsi 3-final} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469413/ [6469414] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:09:14 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469414/ [6469415] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:33 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469415/ [6469416] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469416/ [6469417] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469417/ [6469418] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469418/ [6469419] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_read_write} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469419/ [6469420] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:33:56 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469420/ [6469421] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469421/ [6469422] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:48:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469422/ [6469423] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469423/ [6469424] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:29:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469424/ [6469425] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/mirror 3-final} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469425/ [6469426] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469426/ [6469427] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469427/ [6469429] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469429/ [6469430] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469430/ [6469431] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/insights} time: 00:24:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469431/ [6469432] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469432/ [6469433] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469433/ [6469434] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:25:26 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469434/ [6469435] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:30:29 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469435/ [6469436] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:02 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469436/ [6469438] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469438/ [6469439] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} time: 00:30:31 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469439/ [6469440] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469440/ [6469441] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469441/ [6469442] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469442/ [6469443] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469443/ [6469444] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:17 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469444/ [6469445] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/cosbench_64K_write} time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469445/ [6469446] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} time: 00:30:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469446/ [6469447] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:21:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469447/ [6469448] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469448/ [6469449] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469449/ [6469450] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469450/ [6469451] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469451/ [6469452] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469452/ [6469453] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469453/ [6469454] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:31:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469454/ [6469455] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469455/ [6469456] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:36:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469456/ [6469457] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469457/ [6469458] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469458/ [6469459] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress2 3-final} time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469459/ [6469460] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:29:04 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469460/ [6469461] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:35:31 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469461/ [6469462] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:51:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469462/ [6469463] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469463/ [6469464] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs 3-final} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469464/ [6469465] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469465/ [6469466] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469466/ [6469467] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469467/ [6469468] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469468/ [6469469] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469469/ [6469470] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:28:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469470/ [6469471] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:19:17 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469471/ [6469472] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm_repos} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469472/ [6469473] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469473/ [6469474] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469474/ [6469475] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 04:56:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469475/ [6469476] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} time: 00:23:23 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469476/ [6469477] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:15:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469477/ [6469478] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469478/ [6469479] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469479/ [6469480] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469480/ [6469482] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs2 3-final} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469482/ [6469483] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469483/ [6469484] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469484/ [6469485] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469485/ [6469486] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469486/ [6469487] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:21:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469487/ [6469488] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:18 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469488/ [6469489] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469489/ [6469490] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} time: 00:29:22 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469490/ [6469491] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469491/ [6469492] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw-ingress 3-final} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469492/ [6469493] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469493/ [6469494] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469494/ [6469495] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469495/ [6469496] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469496/ [6469497] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469497/ [6469498] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469498/ [6469499] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/progress} time: 00:33:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469499/ [6469500] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469500/ [6469502] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469502/ [6469503] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:14:06 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469503/ [6469504] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469504/ [6469505] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469505/ [6469506] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/basic 3-final} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469506/ [6469507] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:31:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469507/ [6469508] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:37:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469508/ [6469509] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469509/ [6469510] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:23:02 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469510/ [6469511] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469511/ [6469512] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/valgrind} time: 02:08:56 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469512/ [6469513] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469513/ [6469514] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469514/ [6469515] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:21 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469515/ [6469516] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469516/ [6469517] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469517/ [6469518] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:46:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469518/ [6469520] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469520/ [6469521] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469521/ [6469522] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469522/ [6469523] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469523/ [6469524] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 03:08:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469524/ [6469525] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469525/ [6469526] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/client-keyring 3-final} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469526/ [6469527] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:32:57 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469527/ [6469529] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:29 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469529/ [6469530] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 01:12:48 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469530/ [6469531] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:45:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469531/ [6469532] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:22 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469532/ [6469533] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469533/ [6469534] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469534/ [6469535] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469535/ [6469536] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469536/ [6469537] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469537/ [6469538] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:18:08 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469538/ [6469539] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_rw} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469539/ [6469540] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469540/ [6469541] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469541/ [6469542] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469542/ [6469543] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469543/ [6469544] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469544/ [6469545] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469545/ [6469546] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469546/ [6469547] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/iscsi 3-final} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469547/ [6469548] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:14:08 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469548/ [6469550] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469550/ [6469551] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469551/ [6469552] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:04 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469552/ [6469553] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:48:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469553/ [6469554] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469554/ [6469555] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:02 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469555/ [6469556] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/mirror 3-final} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469556/ [6469557] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:22:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469557/ [6469558] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:01 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469558/ [6469559] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469559/ [6469560] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 01:24:17 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469560/ [6469561] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469561/ [6469562] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469562/ [6469563] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:45:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469563/ [6469564] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_write} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469564/ [6469565] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:56:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469565/ [6469566] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469566/ [6469567] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:18:21 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469567/ [6469568] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469568/ [6469569] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:37:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469569/ [6469570] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469570/ [6469571] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:18:32 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469571/ [6469572] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469572/ [6469573] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469573/ [6469574] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:40:18 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469574/ [6469575] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469575/ [6469576] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469576/ [6469577] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/workunits} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469577/ [6469578] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469578/ [6469579] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469579/ [6469580] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:33:39 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469580/ [6469581] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469581/ [6469582] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469582/ [6469583] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469583/ [6469584] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4K_rand_read} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469584/ [6469585] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469585/ [6469586] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:24:42 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469586/ [6469587] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469587/ [6469588] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:22:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469588/ [6469589] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469589/ [6469590] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/valgrind} time: 00:55:19 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469590/ [6469591] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:37:13 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469591/ [6469592] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469592/ [6469593] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469593/ [6469594] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469594/ [6469595] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 00:52:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469595/ [6469596] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469596/ [6469597] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469597/ [6469598] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs 3-final} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469598/ [6469599] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469599/ [6469600] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:27:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469600/ [6469601] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469601/ [6469602] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:27:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469602/ [6469603] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469603/ [6469604] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469604/ [6469605] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469605/ [6469606] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469606/ [6469607] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs2 3-final} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469607/ [6469608] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469608/ [6469609] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469609/ [6469610] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469610/ [6469611] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_seq_read} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469611/ [6469612] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469612/ [6469613] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:36:14 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469613/ [6469614] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469614/ [6469615] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469615/ [6469616] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw-ingress 3-final} time: 00:17:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469616/ [6469617] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469617/ [6469618] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469618/ [6469619] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469619/ [6469620] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469620/ [6469621] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:42:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469621/ [6469622] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469622/ [6469623] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469623/ [6469624] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469624/ [6469625] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469625/ [6469626] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469626/ [6469627] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/lockdep} time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469627/ [6469628] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469628/ [6469629] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469629/ [6469630] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469630/ [6469631] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469631/ [6469632] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:41:28 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469632/ [6469633] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:31:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469633/ [6469634] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469634/ [6469635] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_rand_read} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469635/ [6469636] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469636/ [6469637] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469637/ [6469638] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469638/ [6469639] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw 3-final} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469639/ [6469640] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:33:42 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469640/ [6469641] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469641/ [6469642] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469642/ [6469643] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:34:03 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469643/ [6469644] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:38:57 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469644/ [6469645] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:19:37 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469645/ [6469646] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469646/ [6469647] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469647/ [6469648] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469648/ [6469649] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/failover} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469649/ [6469650] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469650/ [6469651] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:47:31 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469651/ [6469652] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/client-keyring 3-final} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469652/ [6469653] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:29:52 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469653/ [6469654] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469654/ [6469655] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:35:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469655/ [6469656] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469656/ [6469657] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469657/ [6469658] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469658/ [6469659] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469659/ [6469660] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:24:43 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469660/ [6469661] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:58 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469661/ [6469662] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469662/ [6469663] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:30:12 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469663/ [6469664] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469664/ [6469665] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} time: 00:29:59 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469665/ [6469666] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/iscsi 3-final} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469666/ [6469668] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469668/ [6469669] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:00 info: http://pulpito.ceph.com/teuthology-2021-10-31_03:31:02-rados-pacific-distro-default-smithi/6469669/