2021-01-12T20:42:48.110 INFO:root:teuthology version: 1.0.0-7ba49335 2021-01-12T20:42:48.111 INFO:teuthology.results:subset: '16/100000' 2021-01-12T20:42:48.111 INFO:teuthology.results:seed: '7540' 2021-01-13T12:15:19.662 INFO:root:teuthology version: 1.0.0-7ba49335 2021-01-13T12:15:19.690 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-14T00:08:43.922 INFO:teuthology.results:Tests finished! gathering results... 2021-01-14T00:09:39.292 INFO:scrape:Found 367 jobs 2021-01-14T00:09:48.610 INFO:scrape:Found 10 distinct failure reasons 2021-01-14T00:09:48.611 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-01-14T00:09:48.612 INFO:scrape:1 jobs: ['5779414'] 2021-01-14T00:09:48.612 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-01-14T00:09:48.613 INFO:scrape: 2021-01-14T00:09:48.613 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh' 2021-01-14T00:09:48.613 INFO:scrape:2 jobs: ['5779512', '5779694'] 2021-01-14T00:09:48.614 INFO:scrape:suites intersection: ['workloads/scrub}'] 2021-01-14T00:09:48.614 INFO:scrape:suites union: ['rados/standalone/{mon_election/classic', 'rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/scrub}'] 2021-01-14T00:09:48.615 INFO:scrape: 2021-01-14T00:09:48.615 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2021-01-14T00:09:48.616 INFO:scrape:1 jobs: ['5779677'] 2021-01-14T00:09:48.616 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{default}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2021-01-14T00:09:48.616 INFO:scrape: 2021-01-14T00:09:48.617 INFO:scrape:Dead: b'2021-01-14T00:05:38.038 DEBUG:teuthology.exit:Finished running handlers' 2021-01-14T00:09:48.617 INFO:scrape:6 jobs: ['5779680', '5779578', '5779605', '5779538', '5779426', '5779645'] 2021-01-14T00:09:48.618 INFO:scrape:suites intersection: [] 2021-01-14T00:09:48.618 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'debug/mgr', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/objectstore/{backends/objectstore', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-small-objects}', 'workloads/pool-snaps-few-objects}'] 2021-01-14T00:09:48.618 INFO:scrape: 2021-01-14T00:09:48.619 INFO:scrape:Failure: psutil.NoSuchProcess process no longer exists (pid=3514) 2021-01-14T00:09:48.619 INFO:scrape:1 jobs: ['5779459'] 2021-01-14T00:09:48.620 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{rhel_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2021-01-14T00:09:48.620 INFO:scrape: 2021-01-14T00:09:48.620 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2021-01-14T00:09:48.621 INFO:scrape:2 jobs: ['5779608', '5779389'] 2021-01-14T00:09:48.621 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-14T00:09:48.622 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-14T00:09:48.622 INFO:scrape: 2021-01-14T00:09:48.623 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi132 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-14T00:09:48.623 INFO:scrape:1 jobs: ['5779584'] 2021-01-14T00:09:48.623 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-14T00:09:48.624 INFO:scrape: 2021-01-14T00:09:48.624 INFO:scrape:Failure: Command failed on smithi050 with status 1: 'sudo docker kill -s 1 ceph-1b4905b6-5598-11eb-8f90-001a4aab830c-osd.8' 2021-01-14T00:09:48.624 INFO:scrape:1 jobs: ['5779665'] 2021-01-14T00:09:48.625 INFO:scrape:suites: ['1-install/nautilus-v1only', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'msgr-failures/few', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2021-01-14T00:09:48.625 INFO:scrape: 2021-01-14T00:09:48.626 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-14T00:09:48.626 INFO:scrape:4 jobs: ['5779378', '5779458', '5779416', '5779501'] 2021-01-14T00:09:48.626 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2021-01-14T00:09:48.627 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_latest}', 'distro$/{rhel_8.0}', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2021-01-14T00:09:48.627 INFO:scrape: 2021-01-14T00:09:48.628 INFO:scrape:Failure: {'Failure object was': {'smithi166.front.sepia.ceph.com': {'cmd': ['/bin/pip3', 'install', '-U', 'git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'msg': 'stdout: Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-d_i7duzj-build\\nCollecting toml (from registries-conf-ctl==1.0)\\n\\n:stderr: WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\\n Could not find a version that satisfies the requirement toml (from registries-conf-ctl==1.0) (from versions: )\\nNo matching distribution found for toml (from registries-conf-ctl==1.0)\\n', 'invocation': {'module_args': {'name': ['git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'state': 'latest', 'virtualenv_site_packages': False, 'virtualenv_command': 'virtualenv', 'use_mirrors': True, 'editable': False, 'version': 'None', 'requirements': 'None', 'virtualenv': 'None', 'virtualenv_python': 'None', 'extra_args': 'None', 'chdir': 'None', 'executable': 'None', 'umask': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/bin/pip3')"} 2021-01-14T00:09:48.628 INFO:scrape:1 jobs: ['5779464'] 2021-01-14T00:09:48.629 INFO:scrape:suites: ['clusters/{fixed-4', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash-erasure-code-shec/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}'] 2021-01-14T00:09:48.629 INFO:scrape: 2021-01-14T00:09:48.641 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/ failed: 12 dead: 8 running: 0 waiting: 0 queued: 0 passed: 347 Fail ================================================================= [5779378] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779378/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779378/ sentry: https://sentry.ceph.com/organizations/ceph/?query=147dff6c47334ccd8c60e8deb6c89abc reached maximum tries (180) after waiting for 180 seconds [5779389] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:47:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779389/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=416695d2acf04307a31b8952bffb44de Command failed (workunit test rados/test.sh) on smithi148 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5779414] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779414/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779414/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb10d567155c42db936ea0ad5b2ff911 Command failed (workunit test cephadm/test_adoption.sh) on smithi145 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5779416] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779416/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779416/ sentry: https://sentry.ceph.com/organizations/ceph/?query=503d4e163a8d4634879a02d26f8f9484 reached maximum tries (180) after waiting for 180 seconds [5779458] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779458/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779458/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4877c40427b14a3a88ea07bd991b7131 reached maximum tries (180) after waiting for 180 seconds [5779501] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779501/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779501/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cbaad34630854a97a9bca4d5dba01dd6 reached maximum tries (180) after waiting for 180 seconds [5779512] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/scrub} ----------------------------------------------------------------- time: 01:21:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779512/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c02a46965ff46edaaaf8a2ea823c513 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' [5779584] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779584/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779584/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30959699bf3b417f93c646ef72b122f7 Command failed (workunit test cephadm/test_cephadm.sh) on smithi132 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5779608] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:50:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779608/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779608/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c3ae35f8b624b11a1b9fb14fdd09fbc Command failed (workunit test rados/test.sh) on smithi101 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5779665] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:35:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779665/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779665/ Command failed on smithi050 with status 1: 'sudo docker kill -s 1 ceph-1b4905b6-5598-11eb-8f90-001a4aab830c-osd.8' [5779677] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 03:37:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779677/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779677/ Command failed on smithi065 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [5779694] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} ----------------------------------------------------------------- time: 01:24:18 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779694/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd3c6877d4674c978473c93a82013e77 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae8d603b92af3e4c44b627b8d4a098307a162962 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' Dead ================================================================= [5779426] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779426/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779426/ [5779459] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 11:54:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779459/ psutil.NoSuchProcess process no longer exists (pid=3514) [5779464] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779464/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779464/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dddb019c52434676837589318b85919d {'Failure object was': {'smithi166.front.sepia.ceph.com': {'cmd': ['/bin/pip3', 'install', '-U', 'git+https://github.com/sebastian- philipp/registries-conf-ctl'], 'msg': 'stdout: Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-d_i7duzj- build\\nCollecting toml (from registries-conf-ctl==1.0)\\n\\n:stderr: WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\\n Could not find a version that satisfies the requirement toml (from registries-conf-ctl==1.0) (from versions: )\\nNo matching distribution found for toml (from registries- conf-ctl==1.0)\\n', 'invocation': {'module_args': {'name': ['git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'state': 'latest', 'virtualenv_site_packages': False, 'virtualenv_command': 'virtualenv', 'use_mirrors': True, 'editable': False, 'version': 'None', 'requirements': 'None', 'virtualenv': 'None', 'virtualenv_python': 'None', 'extra_args': 'None', 'chdir': 'None', 'executable': 'None', 'umask': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/bin/pip3')"} [5779538] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779538/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779538/ [5779578] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779578/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779578/ [5779605] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779605/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779605/ [5779645] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779645/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779645/ [5779680] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779680/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779680/ Pass ================================================================= [5779335] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:04:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779335/ [5779336] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779336/ [5779337] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779337/ [5779338] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779338/ [5779339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779339/ [5779340] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779340/ [5779341] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779341/ [5779342] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779342/ [5779343] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:42:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779343/ [5779344] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779344/ [5779345] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779345/ [5779346] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779346/ [5779347] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779347/ [5779348] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779348/ [5779349] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:34:22 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779349/ [5779350] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:44:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779350/ [5779351] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/crash} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779351/ [5779352] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:49:16 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779352/ [5779353] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:07 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779353/ [5779354] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779354/ [5779355] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779355/ [5779356] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779356/ [5779357] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/crush} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779357/ [5779358] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779358/ [5779359] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:20:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779359/ [5779360] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779360/ [5779361] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779361/ [5779362] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779362/ [5779363] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779363/ [5779364] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:32 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779364/ [5779365] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779365/ [5779366] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:35:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779366/ [5779367] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:50:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779367/ [5779368] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779368/ [5779369] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779369/ [5779370] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:12:35 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779370/ [5779371] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779371/ [5779372] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779372/ [5779373] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779373/ [5779374] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779374/ [5779375] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779375/ [5779376] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779376/ [5779377] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:32:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779377/ [5779379] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:30:12 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779379/ [5779380] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779380/ [5779381] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:46:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779381/ [5779382] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779382/ [5779383] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:51 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779383/ [5779384] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779384/ [5779385] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779385/ [5779386] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779386/ [5779387] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:30:32 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779387/ [5779388] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779388/ [5779390] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/failover} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779390/ [5779391] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779391/ [5779392] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779392/ [5779393] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779393/ [5779394] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779394/ [5779395] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:22 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779395/ [5779396] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:37 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779396/ [5779397] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779397/ [5779398] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779398/ [5779399] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779399/ [5779400] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779400/ [5779401] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779401/ [5779402] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779402/ [5779403] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779403/ [5779404] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779404/ [5779405] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779405/ [5779406] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779406/ [5779407] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779407/ [5779408] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779408/ [5779409] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:08:56 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779409/ [5779410] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:41:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779410/ [5779411] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:40:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779411/ [5779412] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779412/ [5779413] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:05:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779413/ [5779415] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:48 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779415/ [5779417] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779417/ [5779418] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779418/ [5779419] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779419/ [5779420] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779420/ [5779421] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:27:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779421/ [5779422] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/insights} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779422/ [5779423] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:32 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779423/ [5779424] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 00:27:04 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779424/ [5779425] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:23 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779425/ [5779427] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779427/ [5779428] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:17:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779428/ [5779429] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779429/ [5779430] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779430/ [5779431] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 02:09:15 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779431/ [5779432] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779432/ [5779433] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779433/ [5779434] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} time: 00:37:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779434/ [5779435] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:23:01 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779435/ [5779436] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:21 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779436/ [5779437] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779437/ [5779438] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779438/ [5779439] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:15 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779439/ [5779440] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779440/ [5779441] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779441/ [5779442] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779442/ [5779443] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:13:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779443/ [5779444] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779444/ [5779445] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779445/ [5779446] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779446/ [5779447] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:28:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779447/ [5779448] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:48:52 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779448/ [5779449] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779449/ [5779450] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779450/ [5779451] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779451/ [5779452] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779452/ [5779453] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779453/ [5779454] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:22:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779454/ [5779455] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:14 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779455/ [5779456] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:28:46 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779456/ [5779457] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mon} time: 00:55:01 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779457/ [5779460] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779460/ [5779461] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779461/ [5779462] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779462/ [5779463] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779463/ [5779465] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779465/ [5779466] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779466/ [5779467] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:29:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779467/ [5779468] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:35 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779468/ [5779469] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779469/ [5779470] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779470/ [5779471] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779471/ [5779472] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779472/ [5779473] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779473/ [5779474] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779474/ [5779475] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779475/ [5779476] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} time: 00:35:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779476/ [5779477] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:14 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779477/ [5779478] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:09:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779478/ [5779479] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:30 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779479/ [5779480] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779480/ [5779481] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779481/ [5779482] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:41:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779482/ [5779483] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:24:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779483/ [5779484] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779484/ [5779485] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:18:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779485/ [5779486] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779486/ [5779487] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779487/ [5779488] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779488/ [5779489] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779489/ [5779490] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779490/ [5779491] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 01:24:24 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779491/ [5779492] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779492/ [5779493] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:19:24 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779493/ [5779494] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779494/ [5779495] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779495/ [5779496] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779496/ [5779497] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779497/ [5779498] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779498/ [5779499] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:35:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779499/ [5779500] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:25 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779500/ [5779502] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779502/ [5779503] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779503/ [5779504] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:35:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779504/ [5779505] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779505/ [5779506] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779506/ [5779507] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779507/ [5779508] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779508/ [5779509] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:33:51 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779509/ [5779510] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779510/ [5779511] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:52:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779511/ [5779513] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779513/ [5779514] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:41:46 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779514/ [5779515] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779515/ [5779516] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779516/ [5779517] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779517/ [5779518] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:24 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779518/ [5779519] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:03:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779519/ [5779520] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779520/ [5779521] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779521/ [5779522] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:21:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779522/ [5779523] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779523/ [5779524] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779524/ [5779525] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:43:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779525/ [5779526] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779526/ [5779527] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:42:04 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779527/ [5779528] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779528/ [5779529] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779529/ [5779530] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779530/ [5779531] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779531/ [5779532] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 02:24:56 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779532/ [5779533] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779533/ [5779534] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779534/ [5779535] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:41 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779535/ [5779536] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779536/ [5779537] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:48:23 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779537/ [5779539] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779539/ [5779540] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:16:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779540/ [5779541] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 04:48:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779541/ [5779542] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779542/ [5779543] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:04:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779543/ [5779544] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779544/ [5779545] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779545/ [5779546] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} time: 00:17:45 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779546/ [5779547] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779547/ [5779548] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:35:35 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779548/ [5779549] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779549/ [5779550] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:36:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779550/ [5779551] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779551/ [5779552] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779552/ [5779553] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779553/ [5779554] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:17:31 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779554/ [5779555] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:29 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779555/ [5779556] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:12:55 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779556/ [5779557] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779557/ [5779558] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779558/ [5779559] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779559/ [5779560] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779560/ [5779561] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779561/ [5779562] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:27:23 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779562/ [5779563] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/workunits} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779563/ [5779564] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:47:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779564/ [5779565] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779565/ [5779566] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779566/ [5779567] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:13 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779567/ [5779568] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:12:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779568/ [5779569] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779569/ [5779570] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779570/ [5779571] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779571/ [5779572] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779572/ [5779573] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779573/ [5779574] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779574/ [5779575] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779575/ [5779576] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779576/ [5779577] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779577/ [5779579] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779579/ [5779580] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:10:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779580/ [5779581] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779581/ [5779582] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779582/ [5779583] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779583/ [5779585] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:38:29 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779585/ [5779586] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779586/ [5779587] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779587/ [5779588] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mgr} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779588/ [5779589] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779589/ [5779590] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779590/ [5779591] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779591/ [5779592] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779592/ [5779593] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779593/ [5779594] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779594/ [5779595] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:51:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779595/ [5779596] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/crash} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779596/ [5779597] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779597/ [5779598] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779598/ [5779599] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779599/ [5779600] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779600/ [5779601] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:21:12 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779601/ [5779602] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779602/ [5779603] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779603/ [5779604] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779604/ [5779606] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779606/ [5779607] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779607/ [5779609] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779609/ [5779610] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:40 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779610/ [5779611] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:29:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779611/ [5779612] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779612/ [5779613] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:47 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779613/ [5779614] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779614/ [5779615] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:31:34 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779615/ [5779616] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:26:13 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779616/ [5779617] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:38:11 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779617/ [5779618] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc} time: 00:36:48 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779618/ [5779619] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779619/ [5779620] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:10:20 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779620/ [5779621] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779621/ [5779622] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779622/ [5779623] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779623/ [5779624] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779624/ [5779625] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779625/ [5779626] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:14:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779626/ [5779627] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:40:52 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779627/ [5779628] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:40:49 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779628/ [5779629] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779629/ [5779630] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:46:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779630/ [5779631] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779631/ [5779632] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779632/ [5779633] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779633/ [5779634] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779634/ [5779635] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779635/ [5779636] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:41:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779636/ [5779637] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 02:14:02 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779637/ [5779638] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:45 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779638/ [5779639] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:34:12 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779639/ [5779640] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779640/ [5779641] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779641/ [5779642] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:25:40 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779642/ [5779643] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:51:31 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779643/ [5779644] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779644/ [5779646] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779646/ [5779647] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779647/ [5779648] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779648/ [5779649] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:22:16 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779649/ [5779650] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779650/ [5779651] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779651/ [5779652] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779652/ [5779653] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779653/ [5779654] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779654/ [5779655] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779655/ [5779656] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779656/ [5779657] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779657/ [5779658] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779658/ [5779659] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779659/ [5779660] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779660/ [5779661] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:18 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779661/ [5779662] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779662/ [5779663] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779663/ [5779664] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779664/ [5779666] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779666/ [5779667] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779667/ [5779668] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/insights} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779668/ [5779669] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd} time: 03:14:55 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779669/ [5779670] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779670/ [5779671] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779671/ [5779672] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779672/ [5779673] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779673/ [5779674] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:20:07 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779674/ [5779675] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:18:17 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779675/ [5779676] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779676/ [5779678] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 02:24:07 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779678/ [5779679] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779679/ [5779681] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779681/ [5779682] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779682/ [5779683] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779683/ [5779684] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:41:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779684/ [5779685] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779685/ [5779686] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779686/ [5779687] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:25:33 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779687/ [5779688] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779688/ [5779689] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:08 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779689/ [5779690] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779690/ [5779691] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779691/ [5779692] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:41:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779692/ [5779693] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779693/ [5779695] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:19:37 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779695/ [5779696] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779696/ [5779697] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779697/ [5779698] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:44 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779698/ [5779699] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779699/ [5779700] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:24:50 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779700/ [5779701] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:07:54 info: http://pulpito.ceph.com/teuthology-2021-01-12_07:01:02-rados-master-distro-basic-smithi/5779701/