2020-10-15T07:21:50.152 INFO:root:teuthology version: 1.0.0-b106d09 2020-10-15T07:21:50.154 INFO:teuthology.results:subset: '11/100000' 2020-10-15T07:21:50.155 INFO:teuthology.results:seed: '1197' 2020-10-15T12:02:28.678 INFO:root:teuthology version: 1.0.0-b106d09 2020-10-15T12:02:28.708 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-10-15T17:17:39.675 INFO:teuthology.results:Tests finished! gathering results... 2020-10-15T17:18:19.507 INFO:scrape:Found 367 jobs 2020-10-15T17:18:25.563 INFO:scrape:Found 5 distinct failure reasons 2020-10-15T17:18:25.565 INFO:scrape:Failure: {'Failure object was': {'smithi098.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} 2020-10-15T17:18:25.565 INFO:scrape:6 jobs: ['5526559', '5526548', '5526546', '5526659', '5526525', '5526426'] 2020-10-15T17:18:25.566 INFO:scrape:suites intersection: [] 2020-10-15T17:18:25.566 INFO:scrape:suites union: ['2-inject-leak/osd', 'centos_latest}', 'ceph', 'clusters/9-mons', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/monthrash/{ceph', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton/{all/deduptool', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'tasks/mon_recovery', 'thrashers/one', 'validater/valgrind}', 'workloads/rados_mon_osdmap_prune}'] 2020-10-15T17:18:25.566 INFO:scrape: 2020-10-15T17:18:25.567 INFO:scrape:Failure: Command failed on smithi068 with status 1: 'sudo yum -y install ceph-test' 2020-10-15T17:18:25.567 INFO:scrape:6 jobs: ['5526539', '5526550', '5526515', '5526320', '5526511', '5526527'] 2020-10-15T17:18:25.567 INFO:scrape:suites intersection: [] 2020-10-15T17:18:25.568 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/multimon/{clusters/3', 'rados/singleton/{all/admin-socket', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}}', 'task/test_orch_cli}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'thrashers/careful', 'thrashers/default', 'thrashosds-health', 'thrashosds-health}', 'validater/lockdep}', 'workloads/cache-pool-snaps}', 'workloads/radosbench-high-concurrency}'] 2020-10-15T17:18:25.568 INFO:scrape: 2020-10-15T17:18:25.568 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=715e83aa9b05c2ea89b28405d66ff8ab3655782b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2020-10-15T17:18:25.568 INFO:scrape:2 jobs: ['5526318', '5526498'] 2020-10-15T17:18:25.569 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-10-15T17:18:25.569 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-10-15T17:18:25.569 INFO:scrape: 2020-10-15T17:18:25.570 INFO:scrape:Failure: "2020-10-15T09:49:34.824363+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log 2020-10-15T17:18:25.570 INFO:scrape:1 jobs: ['5526348'] 2020-10-15T17:18:25.570 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'fast/fast', 'mon_election/connectivity', 'msgr-failures/fastclose', 'openstack}', 'rados', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-small-objects-overwrites}'] 2020-10-15T17:18:25.571 INFO:scrape: 2020-10-15T17:18:25.571 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=715e83aa9b05c2ea89b28405d66ff8ab3655782b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-10-15T17:18:25.571 INFO:scrape:1 jobs: ['5526570'] 2020-10-15T17:18:25.571 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-partial-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2020-10-15T17:18:25.572 INFO:scrape: 2020-10-15T17:18:25.586 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/ failed: 10 dead: 6 running: 0 waiting: 0 queued: 0 passed: 351 Fail ================================================================= [5526318] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526318/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526318/ sentry: https://sentry.ceph.com/sentry/sepia/?query=f23cd7dbbf0b46cdbe2664b67a5c352c Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=715e83aa9b05c2ea89b28405d66ff8ab3655782b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5526320] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:05:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526320/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526320/ sentry: https://sentry.ceph.com/sentry/sepia/?query=51c9d2353937448aa5019f261e724e60 Command failed on smithi063 with status 1: 'sudo yum -y install ceph-test' [5526348] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526348/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526348/ "2020-10-15T09:49:34.824363+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log [5526498] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526498/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526498/ sentry: https://sentry.ceph.com/sentry/sepia/?query=fac75af6d1c54c229b1f06a719ab277a Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=715e83aa9b05c2ea89b28405d66ff8ab3655782b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5526511] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526511/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526511/ sentry: https://sentry.ceph.com/sentry/sepia/?query=b538ae400f7c49d2a80a36cb7071d8d4 Command failed on smithi140 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' [5526515] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526515/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526515/ sentry: https://sentry.ceph.com/sentry/sepia/?query=8555c5cfc51b416b8da8240dfae29320 Command failed on smithi203 with status 1: 'sudo yum -y install ceph-mgr- diskprediction-local' [5526527] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526527/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526527/ sentry: https://sentry.ceph.com/sentry/sepia/?query=b69126288980499d82fbc04c5f976e12 Command failed on smithi159 with status 1: 'sudo yum -y install ceph-test' [5526539] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526539/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526539/ sentry: https://sentry.ceph.com/sentry/sepia/?query=ad8cd65c070b4994beae3f113f6c1706 Command failed on smithi068 with status 1: 'sudo yum -y install ceph-test' [5526550] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:04:30 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526550/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526550/ sentry: https://sentry.ceph.com/sentry/sepia/?query=4fa2352aae9a49a59a4fcb2d29d1815a Command failed on smithi129 with status 1: 'sudo yum -y install ceph-test' [5526570] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526570/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526570/ sentry: https://sentry.ceph.com/sentry/sepia/?query=2f6cff2fb534496ba628eee0538c78c3 Command failed (workunit test rados/test.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=715e83aa9b05c2ea89b28405d66ff8ab3655782b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Dead ================================================================= [5526426] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:02:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526426/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526426/ sentry: https://sentry.ceph.com/sentry/sepia/?query=f56d106c498d414cbce574823f35b505 {'Failure object was': {'smithi103.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5526525] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:02:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526525/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526525/ sentry: https://sentry.ceph.com/sentry/sepia/?query=9551b55bbad5400b9e8c2ebb8dcbde2d {'Failure object was': {'smithi026.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5526546] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526546/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526546/ sentry: https://sentry.ceph.com/sentry/sepia/?query=22ad6cd21612455a89bfbbb9773cc7c0 {'Failure object was': {'smithi072.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost- random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5526548] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:06:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526548/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526548/ sentry: https://sentry.ceph.com/sentry/sepia/?query=e6cfe7640c4d48ce94d4ae32fe1db27c {'Failure object was': {'smithi200.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost- random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5526559] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:02:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526559/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526559/ sentry: https://sentry.ceph.com/sentry/sepia/?query=2aedf609e3b046a5bec22838c8776ab5 {'Failure object was': {'smithi098.front.sepia.ceph.com': {'msg': 'Depsolve Error occured: \\n Problem: cannot install the best candidate for the job\\n - nothing provides libgcc >= 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64\\n - nothing provides libgomp = 8.3.1-5.el8.0.2 needed by gcc-8.3.1-5.el8.0.2.x86_64', 'failures': [], 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev- devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} [5526659] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526659/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526659/ sentry: https://sentry.ceph.com/sentry/sepia/?query=90d01131d2274faba3e51064e44e01fa {'Failure object was': {'smithi005.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/qemu-kvm-block- rbd-2.12.0-88.module_el8.1.0+297+df420408.3.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm- core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} Pass ================================================================= [5526295] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526295/ [5526296] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:24:42 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526296/ [5526297] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:43 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526297/ [5526298] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:30:22 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526298/ [5526299] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526299/ [5526300] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526300/ [5526301] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526301/ [5526302] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526302/ [5526303] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526303/ [5526304] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526304/ [5526305] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:28:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526305/ [5526306] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:33:57 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526306/ [5526307] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:36:57 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526307/ [5526308] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:36:16 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526308/ [5526309] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526309/ [5526310] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526310/ [5526311] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526311/ [5526312] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526312/ [5526313] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/crush} time: 00:15:17 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526313/ [5526314] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:16:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526314/ [5526315] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526315/ [5526316] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:32:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526316/ [5526317] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526317/ [5526319] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526319/ [5526321] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526321/ [5526322] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526322/ [5526323] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526323/ [5526324] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526324/ [5526325] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526325/ [5526326] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526326/ [5526327] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526327/ [5526328] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/progress} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526328/ [5526329] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526329/ [5526330] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:00:30 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526330/ [5526331] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:57 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526331/ [5526332] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:27 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526332/ [5526333] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:23:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526333/ [5526334] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 02:32:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526334/ [5526335] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526335/ [5526336] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526336/ [5526337] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526337/ [5526338] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:22:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526338/ [5526339] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526339/ [5526340] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:37:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526340/ [5526341] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526341/ [5526342] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526342/ [5526343] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526343/ [5526344] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526344/ [5526345] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:57 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526345/ [5526346] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526346/ [5526347] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526347/ [5526349] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526349/ [5526350] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526350/ [5526351] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526351/ [5526352] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526352/ [5526353] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526353/ [5526354] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526354/ [5526355] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526355/ [5526356] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526356/ [5526357] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526357/ [5526358] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526358/ [5526359] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526359/ [5526360] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526360/ [5526361] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526361/ [5526362] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/prometheus} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526362/ [5526363] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526363/ [5526364] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526364/ [5526365] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} time: 00:28:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526365/ [5526366] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526366/ [5526367] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:34:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526367/ [5526368] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526368/ [5526369] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:17:49 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526369/ [5526370] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526370/ [5526371] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 02:08:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526371/ [5526372] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526372/ [5526373] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526373/ [5526374] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526374/ [5526375] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:01 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526375/ [5526376] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:22:20 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526376/ [5526377] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526377/ [5526378] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526378/ [5526379] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526379/ [5526380] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:19:27 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526380/ [5526381] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526381/ [5526382] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526382/ [5526383] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526383/ [5526384] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526384/ [5526385] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526385/ [5526386] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526386/ [5526387] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526387/ [5526388] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/misc} time: 00:28:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526388/ [5526389] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526389/ [5526390] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526390/ [5526391] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526391/ [5526392] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526392/ [5526393] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:32:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526393/ [5526394] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526394/ [5526395] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526395/ [5526396] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:29:16 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526396/ [5526397] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526397/ [5526398] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:25:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526398/ [5526399] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526399/ [5526400] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:07 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526400/ [5526401] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526401/ [5526402] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526402/ [5526403] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:36:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526403/ [5526404] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:27:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526404/ [5526405] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526405/ [5526406] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:54 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526406/ [5526407] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526407/ [5526408] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:52 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526408/ [5526409] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526409/ [5526410] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:28:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526410/ [5526411] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526411/ [5526412] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526412/ [5526413] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526413/ [5526414] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526414/ [5526415] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526415/ [5526416] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526416/ [5526417] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} time: 00:44:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526417/ [5526418] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526418/ [5526419] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:17:58 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526419/ [5526420] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} time: 00:24:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526420/ [5526421] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526421/ [5526422] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526422/ [5526423] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526423/ [5526424] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526424/ [5526425] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526425/ [5526427] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526427/ [5526428] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526428/ [5526429] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/crash} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526429/ [5526430] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:01:59 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526430/ [5526431] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:29:50 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526431/ [5526432] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526432/ [5526433] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526433/ [5526434] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526434/ [5526435] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526435/ [5526436] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526436/ [5526437] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526437/ [5526438] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:32:38 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526438/ [5526439] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526439/ [5526440] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526440/ [5526441] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:23:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526441/ [5526442] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526442/ [5526443] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:46:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526443/ [5526444] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526444/ [5526445] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:11:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526445/ [5526446] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526446/ [5526447] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526447/ [5526448] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:31:45 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526448/ [5526449] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:43 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526449/ [5526450] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526450/ [5526451] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526451/ [5526452] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526452/ [5526453] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526453/ [5526454] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:22 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526454/ [5526455] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526455/ [5526456] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526456/ [5526457] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526457/ [5526458] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526458/ [5526459] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:35:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526459/ [5526460] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:30:59 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526460/ [5526461] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} time: 00:19:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526461/ [5526462] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526462/ [5526463] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:26:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526463/ [5526464] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526464/ [5526465] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub} time: 01:32:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526465/ [5526466] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:14:08 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526466/ [5526467] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:56:22 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526467/ [5526468] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526468/ [5526469] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 04:01:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526469/ [5526470] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:39:20 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526470/ [5526471] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526471/ [5526472] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:26:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526472/ [5526473] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:01:49 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526473/ [5526474] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:05:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526474/ [5526475] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526475/ [5526476] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526476/ [5526477] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:30 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526477/ [5526478] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526478/ [5526479] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526479/ [5526480] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:53 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526480/ [5526481] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526481/ [5526482] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526482/ [5526483] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526483/ [5526484] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:06:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526484/ [5526485] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526485/ [5526486] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:35:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526486/ [5526487] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526487/ [5526488] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526488/ [5526489] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526489/ [5526490] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526490/ [5526491] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:43 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526491/ [5526492] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:32:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526492/ [5526493] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526493/ [5526494] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526494/ [5526495] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/crush} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526495/ [5526496] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:02:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526496/ [5526497] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:30 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526497/ [5526499] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526499/ [5526500] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526500/ [5526501] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:08 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526501/ [5526502] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526502/ [5526503] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526503/ [5526504] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526504/ [5526505] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526505/ [5526506] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526506/ [5526507] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:21:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526507/ [5526508] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526508/ [5526509] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526509/ [5526510] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} time: 00:30:22 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526510/ [5526512] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526512/ [5526513] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 02:11:06 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526513/ [5526514] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526514/ [5526516] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:25 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526516/ [5526517] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526517/ [5526518] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526518/ [5526519] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526519/ [5526520] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:53:49 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526520/ [5526521] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:36:18 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526521/ [5526522] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:35 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526522/ [5526523] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526523/ [5526524] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526524/ [5526526] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526526/ [5526528] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526528/ [5526529] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526529/ [5526530] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526530/ [5526531] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526531/ [5526532] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526532/ [5526533] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526533/ [5526534] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526534/ [5526535] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:22:11 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526535/ [5526536] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526536/ [5526537] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:27:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526537/ [5526538] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526538/ [5526540] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526540/ [5526541] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:35:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526541/ [5526542] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526542/ [5526543] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526543/ [5526544] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mgr} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526544/ [5526545] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526545/ [5526547] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526547/ [5526549] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526549/ [5526551] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526551/ [5526552] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526552/ [5526553] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526553/ [5526554] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:58 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526554/ [5526555] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526555/ [5526556] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526556/ [5526557] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526557/ [5526558] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526558/ [5526560] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526560/ [5526561] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:37:01 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526561/ [5526562] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:09 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526562/ [5526563] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:22:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526563/ [5526564] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526564/ [5526565] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526565/ [5526566] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526566/ [5526567] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526567/ [5526568] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:01 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526568/ [5526569] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526569/ [5526571] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/progress} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526571/ [5526572] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526572/ [5526573] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526573/ [5526574] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:07:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526574/ [5526575] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526575/ [5526576] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526576/ [5526577] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:25 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526577/ [5526578] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526578/ [5526579] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526579/ [5526580] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526580/ [5526581] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526581/ [5526582] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:47:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526582/ [5526583] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526583/ [5526584] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:54:33 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526584/ [5526585] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:25:34 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526585/ [5526586] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:34:05 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526586/ [5526587] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526587/ [5526588] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:47:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526588/ [5526589] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:15 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526589/ [5526590] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526590/ [5526591] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:20:31 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526591/ [5526592] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526592/ [5526593] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526593/ [5526594] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526594/ [5526595] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} time: 02:04:27 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526595/ [5526596] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:59:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526596/ [5526597] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:32 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526597/ [5526598] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:26:25 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526598/ [5526599] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:33:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526599/ [5526600] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mon} time: 00:49:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526600/ [5526601] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526601/ [5526602] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526602/ [5526603] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526603/ [5526604] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526604/ [5526605] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526605/ [5526606] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526606/ [5526607] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526607/ [5526608] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:22 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526608/ [5526609] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526609/ [5526610] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526610/ [5526611] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526611/ [5526612] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526612/ [5526613] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:33:33 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526613/ [5526614] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526614/ [5526615] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526615/ [5526616] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526616/ [5526617] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526617/ [5526618] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526618/ [5526619] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526619/ [5526620] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} time: 00:32:30 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526620/ [5526621] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526621/ [5526622] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526622/ [5526623] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526623/ [5526624] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526624/ [5526625] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526625/ [5526626] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526626/ [5526627] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/osd} time: 03:04:13 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526627/ [5526628] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526628/ [5526629] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526629/ [5526630] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526630/ [5526631] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:21:03 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526631/ [5526632] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526632/ [5526633] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526633/ [5526634] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526634/ [5526635] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:44 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526635/ [5526636] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:14:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526636/ [5526637] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526637/ [5526638] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526638/ [5526639] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526639/ [5526640] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526640/ [5526641] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526641/ [5526642] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:24:25 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526642/ [5526643] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:35:35 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526643/ [5526644] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:23 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526644/ [5526645] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526645/ [5526646] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526646/ [5526647] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:21:07 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526647/ [5526648] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} time: 01:38:18 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526648/ [5526649] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526649/ [5526650] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:31:52 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526650/ [5526651] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:37:00 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526651/ [5526652] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526652/ [5526653] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526653/ [5526654] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526654/ [5526655] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:56 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526655/ [5526656] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526656/ [5526657] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:14:51 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526657/ [5526658] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526658/ [5526660] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526660/ [5526661] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:29 info: http://pulpito.ceph.com/teuthology-2020-10-15_07:01:02-rados-master-distro-basic-smithi/5526661/