2021-11-15T00:04:17.334 INFO:root:teuthology version: 1.1.0-d4737010 2021-11-15T00:04:17.336 INFO:teuthology.results:subset: '14184/99999' 2021-11-15T00:04:17.336 INFO:teuthology.results:seed: '7895' 2021-11-15T05:22:22.974 INFO:root:teuthology version: 1.1.0-d4737010 2021-11-15T05:22:23.013 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-11-15T16:17:25.043 INFO:teuthology.results:Tests finished! gathering results... 2021-11-15T16:18:00.213 INFO:scrape:Found 396 jobs 2021-11-15T16:18:02.659 INFO:scrape:Found 9 distinct failure reasons 2021-11-15T16:18:02.661 INFO:scrape:Failure: Command failed on smithi043 with status 1: 'sudo kubeadm init --node-name smithi043 --token abcdef.pbng723rr531npqu --pod-network-cidr 10.249.80.0/21' 2021-11-15T16:18:02.662 INFO:scrape:3 jobs: ['6502348', '6502225', '6502099'] 2021-11-15T16:18:02.663 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico'] 2021-11-15T16:18:02.664 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}', 'rook/master}'] 2021-11-15T16:18:02.664 INFO:scrape: 2021-11-15T16:18:02.665 INFO:scrape:Failure: Command failed on smithi195 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:6a876a2cefd30b92519d1523d98edb159f9cd443 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86799c22-45cc-11ec-8c2c-001a4aab830c -- ceph orch apply mon '2;smithi016:172.21.15.16=smithi016;smithi195:172.21.15.195=smithi195'" 2021-11-15T16:18:02.666 INFO:scrape:5 jobs: ['6502389', '6502244', '6502374', '6502317', '6502335'] 2021-11-15T16:18:02.667 INFO:scrape:suites intersection: [] 2021-11-15T16:18:02.668 INFO:scrape:suites union: ['1-start', '2-services/client-keyring', '2-services/iscsi', '3-final}', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0', 'rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0', 'start}'] 2021-11-15T16:18:02.669 INFO:scrape: 2021-11-15T16:18:02.670 INFO:scrape:Dead: b'2021-11-15T16:14:12.440 DEBUG:teuthology.exit:Finished running handlers' 2021-11-15T16:18:02.671 INFO:scrape:2 jobs: ['6502379', '6502214'] 2021-11-15T16:18:02.672 INFO:scrape:suites intersection: [] 2021-11-15T16:18:02.673 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'clusters/{fixed-2', 'fast/normal', 'mon_election/classic', 'msgr-failures/osd-delay', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-small-objects-many-deletes}'] 2021-11-15T16:18:02.673 INFO:scrape: 2021-11-15T16:18:02.674 INFO:scrape:Failure: list index out of range 2021-11-15T16:18:02.675 INFO:scrape:2 jobs: ['6502421', '6502218'] 2021-11-15T16:18:02.676 INFO:scrape:suites intersection: ['rados/cephadm/osds/2-ops/rm-zap-flag'] 2021-11-15T16:18:02.677 INFO:scrape:suites union: ['rados/cephadm/osds/2-ops/rm-zap-flag'] 2021-11-15T16:18:02.678 INFO:scrape: 2021-11-15T16:18:02.679 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi102 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a876a2cefd30b92519d1523d98edb159f9cd443 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-11-15T16:18:02.680 INFO:scrape:2 jobs: ['6502411', '6502210'] 2021-11-15T16:18:02.681 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0', 'task/test_e2e}'] 2021-11-15T16:18:02.681 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0', 'task/test_e2e}'] 2021-11-15T16:18:02.682 INFO:scrape: 2021-11-15T16:18:02.683 INFO:scrape:Failure: Command failed (workunit test rados/test_python.sh) on smithi170 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a876a2cefd30b92519d1523d98edb159f9cd443 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' 2021-11-15T16:18:02.684 INFO:scrape:1 jobs: ['6502434'] 2021-11-15T16:18:02.685 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8}', 'tasks/rados_python}'] 2021-11-15T16:18:02.685 INFO:scrape: 2021-11-15T16:18:02.686 INFO:scrape:Failure: {'Failure object was': {'smithi007.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"} 2021-11-15T16:18:02.686 INFO:scrape:1 jobs: ['6502085'] 2021-11-15T16:18:02.687 INFO:scrape:suites: ['debug/mgr', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/prometheus}'] 2021-11-15T16:18:02.687 INFO:scrape: 2021-11-15T16:18:02.688 INFO:scrape:Failure: Test failure: test_ganesha (unittest.loader._FailedTest) 2021-11-15T16:18:02.688 INFO:scrape:2 jobs: ['6502203', '6502401'] 2021-11-15T16:18:02.689 INFO:scrape:suites intersection: ['clusters/{2-node-mgr}', 'debug/mgr', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'tasks/dashboard}'] 2021-11-15T16:18:02.689 INFO:scrape:suites union: ['clusters/{2-node-mgr}', 'debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-comp-zlib}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/dashboard}'] 2021-11-15T16:18:02.689 INFO:scrape: 2021-11-15T16:18:02.690 INFO:scrape:Failure: Found coredumps on ubuntu@smithi119.front.sepia.ceph.com 2021-11-15T16:18:02.690 INFO:scrape:1 jobs: ['6502414'] 2021-11-15T16:18:02.691 INFO:scrape:suites: ['1-bootstrap/16.2.4', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0'] 2021-11-15T16:18:02.691 INFO:scrape: 2021-11-15T16:18:02.704 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/ failed: 16 dead: 3 running: 0 waiting: 0 queued: 0 passed: 377 Fail ================================================================= [6502099] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502099/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502099/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc3180354c3e494287f7e7fc91fc3f31 Command failed on smithi016 with status 1: 'sudo kubeadm init --node-name smithi016 --token abcdef.5u7asy0f5eia9ikd --pod-network-cidr 10.248.120.0/21' [6502203] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502203/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502203/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a6fea63ad96442e9278d64d00600a26 Test failure: test_ganesha (unittest.loader._FailedTest) [6502210] rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502210/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=185b3f5df19e499db36e90ba0d1220af Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a876a2cefd30b92519d1523d98edb159f9cd443 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6502218] rados/cephadm/osds/2-ops/rm-zap-flag ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502218/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502218/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3418c1c012904fa286eb8392afff9ad6 list index out of range [6502225] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:15 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502225/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502225/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9bf472aa3269444baa60fdcddf42b48b Command failed on smithi165 with status 1: 'sudo kubeadm init --node-name smithi165 --token abcdef.pri5flg5e2x6alq8 --pod-network-cidr 10.253.32.0/21' [6502244] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502244/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b7372078dcd47e6b60b79ae6108dd3c Command failed on smithi186 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6a876a2cefd30b92519d1523d98edb159f9cd443 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid baba9e72-45be-11ec-8c2c-001a4aab830c -- ceph mon dump -f json' [6502317] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502317/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502317/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd427a4fcd8942e9b32b0466c4573586 Command failed on smithi121 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6a876a2cefd30b92519d1523d98edb159f9cd443 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 56c0f9e6-45c5-11ec-8c2c-001a4aab830c -- ceph mon dump -f json' [6502335] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502335/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502335/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f1944d729624f12a9e814b50184a850 Command failed on smithi181 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6a876a2cefd30b92519d1523d98edb159f9cd443 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 66a141de-45c7-11ec-8c2c-001a4aab830c -- ceph mon dump -f json' [6502348] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502348/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502348/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1795414873644832950cb598f8930ddd Command failed on smithi043 with status 1: 'sudo kubeadm init --node-name smithi043 --token abcdef.pbng723rr531npqu --pod-network-cidr 10.249.80.0/21' [6502374] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502374/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502374/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48ef99997de74868bfc9a28a50d234a4 Command failed on smithi137 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6a876a2cefd30b92519d1523d98edb159f9cd443 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 75c381c8-45cb-11ec-8c2c-001a4aab830c -- ceph orch apply mon '2;smithi116:172.21.15.116=smithi116;smithi137:172.21.15.137=smithi137'" [6502389] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502389/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34b70aa8f3914cfca8ba5d230e3840e1 Command failed on smithi195 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6a876a2cefd30b92519d1523d98edb159f9cd443 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86799c22-45cc-11ec-8c2c-001a4aab830c -- ceph orch apply mon '2;smithi016:172.21.15.16=smithi016;smithi195:172.21.15.195=smithi195'" [6502401] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:38:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502401/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502401/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67cfe977ac7a4a6e972654674dacd13a Test failure: test_ganesha (unittest.loader._FailedTest) [6502411] rados/cephadm/dashboard/{0-distro/centos_8.2_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502411/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502411/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb13e814c45843cbba910050e0df1803 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi102 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a876a2cefd30b92519d1523d98edb159f9cd443 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6502414] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:28:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502414/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502414/ Found coredumps on ubuntu@smithi119.front.sepia.ceph.com [6502421] rados/cephadm/osds/2-ops/rm-zap-flag ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502421/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502421/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9041bf534b4d4ac7b4e5d3fc593f2fe2 list index out of range [6502434] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502434/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3683e601af2d4aeaa91ea21f43dd3e47 Command failed (workunit test rados/test_python.sh) on smithi170 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a876a2cefd30b92519d1523d98edb159f9cd443 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' Dead ================================================================= [6502085] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/prometheus} ----------------------------------------------------------------- time: 00:03:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502085/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27c12b1d5f2f403d85503ad552db54b8 {'Failure object was': {'smithi007.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/pyt hon3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker /src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/v irtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python 3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teut hology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/si te-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/vir tualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a8509 9043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python 3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/vir tualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a8509 9043cf081dc05b4069d301b23fb/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_ teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/lib/python3. 6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"} [6502214] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502214/ hit max job timeout [6502379] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502379/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502379/ hit max job timeout Pass ================================================================= [6502064] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:40:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502064/ [6502065] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:27:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502065/ [6502066] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502066/ [6502067] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/iscsi 3-final} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502067/ [6502068] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502068/ [6502069] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502069/ [6502070] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:40:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502070/ [6502071] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:07:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502071/ [6502072] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 01:25:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502072/ [6502073] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502073/ [6502074] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502074/ [6502075] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502075/ [6502076] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502076/ [6502077] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:30:15 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502077/ [6502078] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 01:52:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502078/ [6502079] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502079/ [6502080] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/mirror 3-final} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502080/ [6502081] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:21:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502081/ [6502082] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:36:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502082/ [6502083] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:42:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502083/ [6502084] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:43:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502084/ [6502086] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502086/ [6502087] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:34:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502087/ [6502088] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502088/ [6502089] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502089/ [6502090] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502090/ [6502091] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502091/ [6502092] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502092/ [6502093] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:20:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502093/ [6502094] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502094/ [6502095] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502095/ [6502096] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502096/ [6502097] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:08:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502097/ [6502098] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:34:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502098/ [6502100] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502100/ [6502101] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502101/ [6502102] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502102/ [6502103] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502103/ [6502104] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:42:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502104/ [6502105] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} time: 00:17:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502105/ [6502106] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502106/ [6502107] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502107/ [6502108] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:19:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502108/ [6502109] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502109/ [6502110] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} time: 00:27:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502110/ [6502111] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502111/ [6502112] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502112/ [6502113] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502113/ [6502114] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:45:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502114/ [6502115] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:15 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502115/ [6502116] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502116/ [6502117] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502117/ [6502118] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502118/ [6502119] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502119/ [6502120] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502120/ [6502121] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502121/ [6502122] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502122/ [6502123] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/workunits} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502123/ [6502124] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502124/ [6502125] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502125/ [6502126] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502126/ [6502127] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502127/ [6502128] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:20:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502128/ [6502129] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:33:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502129/ [6502130] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502130/ [6502131] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502131/ [6502132] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502132/ [6502133] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:49:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502133/ [6502134] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502134/ [6502135] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/nfs 3-final} time: 00:18:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502135/ [6502136] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502136/ [6502137] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:23:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502137/ [6502138] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502138/ [6502139] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502139/ [6502140] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502140/ [6502141] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502141/ [6502142] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502142/ [6502143] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502143/ [6502144] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502144/ [6502145] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502145/ [6502146] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502146/ [6502147] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:20:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502147/ [6502148] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:39:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502148/ [6502149] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:06:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502149/ [6502150] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs2 3-final} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502150/ [6502151] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502151/ [6502152] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502152/ [6502153] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_rw} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502153/ [6502154] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502154/ [6502155] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 00:44:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502155/ [6502156] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:29:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502156/ [6502157] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm_repos} time: 00:06:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502157/ [6502158] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:32:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502158/ [6502159] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:30:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502159/ [6502160] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502160/ [6502161] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:31:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502161/ [6502162] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502162/ [6502163] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw-ingress 3-final} time: 00:20:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502163/ [6502164] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:36:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502164/ [6502165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:32:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502165/ [6502166] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502166/ [6502167] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502167/ [6502168] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:28:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502168/ [6502169] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502169/ [6502170] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502170/ [6502171] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502171/ [6502172] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502172/ [6502173] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502173/ [6502174] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:30:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502174/ [6502175] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_write} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502175/ [6502176] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:30:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502176/ [6502177] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:21:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502177/ [6502178] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502178/ [6502179] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:29:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502179/ [6502180] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502180/ [6502181] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502181/ [6502182] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:43:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502182/ [6502183] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:42:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502183/ [6502184] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/rgw 3-final} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502184/ [6502185] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:42:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502185/ [6502186] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502186/ [6502187] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync workloads/snaps-few-objects} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502187/ [6502188] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:47:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502188/ [6502189] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502189/ [6502190] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/basic 3-final} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502190/ [6502191] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 01:07:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502191/ [6502192] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:35:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502192/ [6502193] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502193/ [6502194] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502194/ [6502195] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502195/ [6502196] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:22:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502196/ [6502197] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502197/ [6502198] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/failover} time: 00:25:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502198/ [6502199] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502199/ [6502200] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:37:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502200/ [6502201] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4K_rand_read} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502201/ [6502202] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/client-keyring 3-final} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502202/ [6502204] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:17:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502204/ [6502205] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:06:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502205/ [6502206] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502206/ [6502207] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502207/ [6502208] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502208/ [6502209] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502209/ [6502211] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502211/ [6502212] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:31:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502212/ [6502213] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:35:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502213/ [6502215] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502215/ [6502216] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502216/ [6502217] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502217/ [6502219] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502219/ [6502220] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502220/ [6502221] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:31:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502221/ [6502222] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502222/ [6502223] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:37:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502223/ [6502224] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502224/ [6502226] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502226/ [6502227] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502227/ [6502228] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:18:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502228/ [6502229] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_seq_read} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502229/ [6502230] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502230/ [6502231] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502231/ [6502232] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502232/ [6502233] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:06:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502233/ [6502234] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:42:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502234/ [6502235] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:34:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502235/ [6502236] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502236/ [6502237] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:24:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502237/ [6502238] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/iscsi 3-final} time: 00:19:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502238/ [6502239] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/insights} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502239/ [6502240] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:34:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502240/ [6502241] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502241/ [6502242] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502242/ [6502243] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:20:18 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502243/ [6502245] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502245/ [6502246] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:23:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502246/ [6502247] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502247/ [6502248] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502248/ [6502249] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502249/ [6502250] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/mirror 3-final} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502250/ [6502251] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502251/ [6502252] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_rand_read} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502252/ [6502253] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502253/ [6502254] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:33:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502254/ [6502255] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502255/ [6502256] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:54:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502256/ [6502257] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502257/ [6502258] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502258/ [6502259] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:18:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502259/ [6502260] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 00:42:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502260/ [6502261] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:06:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502261/ [6502262] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502262/ [6502263] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:41:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502263/ [6502264] rados/singleton/{all/deduptool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502264/ [6502265] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:48:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502265/ [6502266] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_5925} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502266/ [6502267] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502267/ [6502268] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:36:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502268/ [6502269] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502269/ [6502270] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502270/ [6502271] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502271/ [6502272] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502272/ [6502273] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502273/ [6502274] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502274/ [6502275] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502275/ [6502276] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502276/ [6502277] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502277/ [6502278] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502278/ [6502279] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502279/ [6502280] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502280/ [6502281] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502281/ [6502282] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502282/ [6502283] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502283/ [6502284] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502284/ [6502285] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:20:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502285/ [6502286] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:46:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502286/ [6502287] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502287/ [6502288] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502288/ [6502289] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502289/ [6502290] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:16:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502290/ [6502291] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502291/ [6502292] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:35:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502292/ [6502293] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502293/ [6502294] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502294/ [6502295] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502295/ [6502296] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502296/ [6502297] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502297/ [6502298] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502298/ [6502299] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502299/ [6502300] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502300/ [6502301] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:43:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502301/ [6502302] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_write} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502302/ [6502303] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/nfs 3-final} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502303/ [6502304] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:32:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502304/ [6502305] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502305/ [6502306] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:32:33 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502306/ [6502307] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502307/ [6502308] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502308/ [6502309] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502309/ [6502310] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502310/ [6502311] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/nfs2 3-final} time: 00:18:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502311/ [6502312] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:44:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502312/ [6502313] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/progress} time: 00:34:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502313/ [6502314] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502314/ [6502315] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502315/ [6502316] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 01:10:49 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502316/ [6502318] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:32:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502318/ [6502319] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502319/ [6502320] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502320/ [6502321] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502321/ [6502322] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502322/ [6502323] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502323/ [6502324] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:27 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502324/ [6502325] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:24:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502325/ [6502326] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502326/ [6502327] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_omap_write} time: 00:27:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502327/ [6502328] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502328/ [6502329] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502329/ [6502330] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:30:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502330/ [6502331] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502331/ [6502332] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw-ingress 3-final} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502332/ [6502333] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:36:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502333/ [6502334] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:17:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502334/ [6502336] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502336/ [6502337] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502337/ [6502338] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502338/ [6502339] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502339/ [6502340] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502340/ [6502341] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:37:25 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502341/ [6502342] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:40:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502342/ [6502343] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:50:20 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502343/ [6502344] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:42:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502344/ [6502345] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502345/ [6502346] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502346/ [6502347] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:25:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502347/ [6502349] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502349/ [6502350] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/sample_fio} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502350/ [6502351] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/prometheus} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502351/ [6502352] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502352/ [6502353] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502353/ [6502354] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm_repos} time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502354/ [6502355] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502355/ [6502356] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502356/ [6502357] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/basic 3-final} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502357/ [6502358] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:51:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502358/ [6502359] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:33:43 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502359/ [6502360] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:30:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502360/ [6502361] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502361/ [6502362] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:33:53 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502362/ [6502363] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502363/ [6502364] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 01:01:10 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502364/ [6502365] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502365/ [6502366] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502366/ [6502367] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:02 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502367/ [6502368] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:29:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502368/ [6502369] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:31:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502369/ [6502370] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502370/ [6502371] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502371/ [6502372] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:41:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502372/ [6502373] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/sample_radosbench} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502373/ [6502375] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502375/ [6502376] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502376/ [6502377] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502377/ [6502378] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502378/ [6502380] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:53:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502380/ [6502381] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502381/ [6502382] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502382/ [6502383] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:28:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502383/ [6502384] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} time: 00:25:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502384/ [6502385] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502385/ [6502386] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:57:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502386/ [6502387] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502387/ [6502388] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/workunits} time: 00:21:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502388/ [6502390] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:30:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502390/ [6502391] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502391/ [6502392] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:45:00 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502392/ [6502393] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502393/ [6502394] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:16:52 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502394/ [6502395] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502395/ [6502396] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502396/ [6502397] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502397/ [6502398] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_read_write} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502398/ [6502399] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/mirror 3-final} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502399/ [6502400] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 01:04:47 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502400/ [6502402] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502402/ [6502403] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502403/ [6502404] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502404/ [6502405] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502405/ [6502406] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:56:22 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502406/ [6502407] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502407/ [6502408] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:48:32 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502408/ [6502409] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502409/ [6502410] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:45:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502410/ [6502412] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502412/ [6502413] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502413/ [6502415] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502415/ [6502416] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502416/ [6502417] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502417/ [6502418] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:35 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502418/ [6502419] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502419/ [6502420] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:34:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502420/ [6502422] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502422/ [6502423] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502423/ [6502424] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:25:23 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502424/ [6502425] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502425/ [6502426] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/cosbench_64K_write} time: 00:29:08 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502426/ [6502427] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502427/ [6502428] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/crash} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502428/ [6502429] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502429/ [6502430] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502430/ [6502431] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:39:41 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502431/ [6502432] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:29:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502432/ [6502433] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502433/ [6502435] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:17:29 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502435/ [6502436] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502436/ [6502437] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:34:58 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502437/ [6502438] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502438/ [6502439] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:25:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502439/ [6502440] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502440/ [6502441] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:39:19 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502441/ [6502442] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502442/ [6502443] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502443/ [6502444] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502444/ [6502445] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress 3-final} time: 00:19:42 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502445/ [6502446] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502446/ [6502447] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502447/ [6502448] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:34:09 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502448/ [6502449] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502449/ [6502450] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502450/ [6502451] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502451/ [6502452] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:38:34 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502452/ [6502453] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502453/ [6502454] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502454/ [6502455] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:51 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502455/ [6502456] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502456/ [6502457] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502457/ [6502458] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:38:30 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502458/ [6502459] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:51:03 info: http://pulpito.ceph.com/teuthology-2021-11-14_03:31:02-rados-pacific-distro-default-smithi/6502459/