2020-11-13T07:50:58.135 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-13T07:50:58.136 INFO:teuthology.results:subset: '12/100000' 2020-11-13T07:50:58.136 INFO:teuthology.results:seed: '2903' 2020-11-13T11:19:15.867 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-13T11:19:15.907 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-13T16:28:27.388 INFO:teuthology.results:Tests finished! gathering results... 2020-11-13T16:29:10.734 INFO:scrape:Found 367 jobs 2020-11-13T16:29:11.685 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7127-g275a3352 (275a3352f10fdfec18edb965656851f6f0c7f38e) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7f3bb0f9b3fb] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x55c76e9939b0] 2020-11-13T16:29:11.687 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-13T10:04:31.944 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-13T10:04:32.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-11-13T16:29:11.688 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2020-11-13T16:29:11.688 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:06:37.508 INFO:teuthology.orchestra.run.smithi156.stdout:+hv04.front.sepi 144.172.126.201 3 u 45 64 177 0.112 -4.904 1.383 , 2020-11-13T10:06:37.512 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-11-13T10:06:37.524 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2020-11-13T16:29:11.786 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7127-g275a3352 (275a3352f10fdfec18edb965656851f6f0c7f38e) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7f3bb0f9b3fb] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x55c76e9939b0] 2020-11-13T16:29:11.788 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-13T10:04:31.944 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-13T10:04:32.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-11-13T16:29:11.788 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2020-11-13T16:29:11.789 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:06:37.508 INFO:teuthology.orchestra.run.smithi156.stdout:+hv04.front.sepi 144.172.126.201 3 u 45 64 177 0.112 -4.904 1.383 , 2020-11-13T10:06:37.512 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-11-13T10:06:37.524 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2020-11-13T16:29:11.886 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7127-g275a3352 (275a3352f10fdfec18edb965656851f6f0c7f38e) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7f3bb0f9b3fb] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x55c76e9939b0] 2020-11-13T16:29:11.889 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-13T10:04:31.944 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-13T10:04:32.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-11-13T16:29:11.889 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2020-11-13T16:29:11.890 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:06:37.508 INFO:teuthology.orchestra.run.smithi156.stdout:+hv04.front.sepi 144.172.126.201 3 u 45 64 177 0.112 -4.904 1.383 , 2020-11-13T10:06:37.512 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-11-13T10:06:37.524 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2020-11-13T16:29:11.987 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7127-g275a3352 (275a3352f10fdfec18edb965656851f6f0c7f38e) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7f3bb0f9b3fb] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x55c76e9939b0] 2020-11-13T16:29:11.989 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-13T10:04:31.944 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-13T10:04:32.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-11-13T16:29:11.990 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2020-11-13T16:29:11.990 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:06:37.508 INFO:teuthology.orchestra.run.smithi156.stdout:+hv04.front.sepi 144.172.126.201 3 u 45 64 177 0.112 -4.904 1.383 , 2020-11-13T10:06:37.512 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-11-13T10:06:37.524 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2020-11-13T16:29:12.089 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-7127-g275a3352 (275a3352f10fdfec18edb965656851f6f0c7f38e) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe1) [0x7f3bb0f9b3fb] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x6b0) [0x55c76e9939b0] 2020-11-13T16:29:12.091 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-13T10:04:31.944 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-13T10:04:32.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-11-13T16:29:12.092 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s , 2020-11-13T10:05:54.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2020-11-13T16:29:12.092 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-13T10:06:37.508 INFO:teuthology.orchestra.run.smithi156.stdout:+hv04.front.sepi 144.172.126.201 3 u 45 64 177 0.112 -4.904 1.383 , 2020-11-13T10:06:37.512 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab , 2020-11-13T10:06:37.524 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2020-11-13T16:29:16.858 INFO:scrape:Found 10 distinct failure reasons 2020-11-13T16:29:16.859 INFO:scrape:Failure: Command failed on smithi101 with status 5: 'sudo systemctl stop ceph-89bcda1e-2595-11eb-a2b0-001a4aab830c@mon.a' 2020-11-13T16:29:16.860 INFO:scrape:4 jobs: ['5619375', '5619246', '5619467', '5619287'] 2020-11-13T16:29:16.860 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-11-13T16:29:16.860 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-11-13T16:29:16.861 INFO:scrape: 2020-11-13T16:29:16.861 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi092 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2020-11-13T16:29:16.861 INFO:scrape:2 jobs: ['5619411', '5619231'] 2020-11-13T16:29:16.862 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-11-13T16:29:16.862 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-11-13T16:29:16.862 INFO:scrape: 2020-11-13T16:29:16.862 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-11-13T16:29:16.863 INFO:scrape:1 jobs: ['5619393'] 2020-11-13T16:29:16.863 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{ubuntu_latest}}'] 2020-11-13T16:29:16.863 INFO:scrape: 2020-11-13T16:29:16.864 INFO:scrape:Failure: "2020-11-13T11:16:44.219943+0000 osd.6 (osd.6) 584 : cluster [ERR] 5.11 deep-scrub : stat mismatch, got 4/4 objects, 0/0 clones, 0/0 dirty, 0/0 omap, 0/0 pinned, 4/4 hit_set_archive, 0/0 whiteouts, 6468/0 bytes, 0/0 manifest objects, 6468/6468 hit_set_archive bytes." in cluster log 2020-11-13T16:29:16.864 INFO:scrape:1 jobs: ['5619227'] 2020-11-13T16:29:16.864 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'mon_election/classic', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2020-11-13T16:29:16.864 INFO:scrape: 2020-11-13T16:29:16.865 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2020-11-13T16:29:16.865 INFO:scrape:2 jobs: ['5619371', '5619230'] 2020-11-13T16:29:16.865 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/centos_latest', 'task/test_adoption}'] 2020-11-13T16:29:16.866 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'task/test_adoption}'] 2020-11-13T16:29:16.866 INFO:scrape: 2020-11-13T16:29:16.866 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi062 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2020-11-13T16:29:16.867 INFO:scrape:3 jobs: ['5619404', '5619274', '5619543'] 2020-11-13T16:29:16.867 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2020-11-13T16:29:16.867 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2020-11-13T16:29:16.867 INFO:scrape: 2020-11-13T16:29:16.868 INFO:scrape:Failure: Command failed (workunit test misc/ver-health.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh' 2020-11-13T16:29:16.868 INFO:scrape:2 jobs: ['5619485', '5619300'] 2020-11-13T16:29:16.868 INFO:scrape:suites intersection: ['workloads/misc}'] 2020-11-13T16:29:16.869 INFO:scrape:suites union: ['rados/standalone/{mon_election/classic', 'rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/misc}'] 2020-11-13T16:29:16.869 INFO:scrape: 2020-11-13T16:29:16.869 INFO:scrape:Failure: {'Failure object was': {'smithi204.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost-random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} 2020-11-13T16:29:16.870 INFO:scrape:1 jobs: ['5619530'] 2020-11-13T16:29:16.870 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/classic', 'msgr-failures/osd-delay', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2020-11-13T16:29:16.870 INFO:scrape: 2020-11-13T16:29:16.871 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-11-13T16:29:16.871 INFO:scrape:2 jobs: ['5619516', '5619555'] 2020-11-13T16:29:16.871 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'distro$/{rhel_latest}', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-11-13T16:29:16.871 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-11-13T16:29:16.872 INFO:scrape: 2020-11-13T16:29:16.872 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2020-11-13T16:29:16.872 INFO:scrape:1 jobs: ['5619353'] 2020-11-13T16:29:16.873 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/sync', 'workloads/rados_mon_workunits}'] 2020-11-13T16:29:16.873 INFO:scrape: 2020-11-13T16:29:16.887 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/ failed: 18 dead: 1 running: 0 waiting: 0 queued: 0 passed: 348 Fail ================================================================= [5619227] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 05:28:59 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619227/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619227/ "2020-11-13T11:16:44.219943+0000 osd.6 (osd.6) 584 : cluster [ERR] 5.11 deep-scrub : stat mismatch, got 4/4 objects, 0/0 clones, 0/0 dirty, 0/0 omap, 0/0 pinned, 4/4 hit_set_archive, 0/0 whiteouts, 6468/0 bytes, 0/0 manifest objects, 6468/6468 hit_set_archive bytes." in cluster log [5619230] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9058ea160be44bc94fbf98174e0f753 Command failed (workunit test cephadm/test_adoption.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5619231] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:31:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619231/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0a3e2b4b75d492aa146167c821304b2 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi097 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5619246] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:02:44 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619246/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9bcc818bf7b54a2c883de890b0c73bb9 Command failed on smithi203 with status 5: 'sudo systemctl stop ceph-6a134dfe-258d-11eb-a2b0-001a4aab830c@mon.a' [5619274] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619274/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619274/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca732123e7ea4303b917cc128954b854 Command failed (workunit test cephadm/test_cephadm.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5619287] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:02:46 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619287/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=acd0903b1c584c3e93aa1f17216dbe33 Command failed on smithi007 with status 5: 'sudo systemctl stop ceph-1a93d016-2590-11eb-a2b0-001a4aab830c@mon.a' [5619300] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} ----------------------------------------------------------------- time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619300/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619300/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1853de8d54794d718b6aaaf229466816 Command failed (workunit test misc/ver-health.sh) on smithi091 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh' [5619353] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:22:49 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619353/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619353/ sentry: https://sentry.ceph.com/organizations/ceph/?query=266166087af84448ac4a9ce91d69aad4 Command failed (workunit test mon/caps.sh) on smithi072 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5619371] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619371/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619371/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79b62079cabf40bd9561c0c54d5f9c3c Command failed (workunit test cephadm/test_adoption.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5619375] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:02:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619375/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619375/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c53541a58a9641bfbaf676a2cda0330d Command failed on smithi101 with status 5: 'sudo systemctl stop ceph-89bcda1e-2595-11eb-a2b0-001a4aab830c@mon.a' [5619393] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619393/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619393/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5619404] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619404/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619404/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22ef807b1e94417bb5994aa802362a49 Command failed (workunit test cephadm/test_cephadm.sh) on smithi062 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5619411] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:31:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619411/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619411/ sentry: https://sentry.ceph.com/organizations/ceph/?query=43c64a5f92e0498085f2dc22932ec4a0 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi092 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5619467] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:02:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619467/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619467/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e6a2195dbd44a50a8605339456ca022 Command failed on smithi079 with status 5: 'sudo systemctl stop ceph-2b169cb8-259d-11eb-a2b0-001a4aab830c@mon.a' [5619485] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} ----------------------------------------------------------------- time: 00:29:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619485/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619485/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d68b027716d84457a344f153d6cd109b Command failed (workunit test misc/ver-health.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh' [5619516] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619516/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d76f2b655754e20b02f2e3026c65ece reached maximum tries (180) after waiting for 180 seconds [5619543] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619543/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619543/ sentry: https://sentry.ceph.com/organizations/ceph/?query=121cf89438e845bfb4956bc7c1aaed86 Command failed (workunit test cephadm/test_cephadm.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=275a3352f10fdfec18edb965656851f6f0c7f38e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5619555] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:23 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619555/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619555/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84d62a5b905d49efa7b3afbd511941e1 reached maximum tries (180) after waiting for 180 seconds Dead ================================================================= [5619530] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:02:40 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619530/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619530/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1be17c54566d4f7d9c08fee2768665f3 {'Failure object was': {'smithi204.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost- random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} Pass ================================================================= [5619208] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619208/ [5619209] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619209/ [5619210] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:26:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619210/ [5619211] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619211/ [5619212] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619212/ [5619213] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619213/ [5619214] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619214/ [5619215] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:20:32 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619215/ [5619216] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619216/ [5619217] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619217/ [5619218] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619218/ [5619219] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/crash} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619219/ [5619220] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619220/ [5619221] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:41:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619221/ [5619222] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:40 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619222/ [5619223] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619223/ [5619224] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619224/ [5619225] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619225/ [5619226] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619226/ [5619228] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619228/ [5619229] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:19:20 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619229/ [5619232] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619232/ [5619233] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619233/ [5619234] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619234/ [5619235] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619235/ [5619236] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619236/ [5619237] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:32:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619237/ [5619238] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619238/ [5619239] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619239/ [5619240] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619240/ [5619241] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619241/ [5619242] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619242/ [5619243] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_5925} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619243/ [5619244] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619244/ [5619245] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619245/ [5619247] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619247/ [5619248] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619248/ [5619249] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619249/ [5619250] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:16:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619250/ [5619251] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:31:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619251/ [5619252] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:43:59 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619252/ [5619253] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619253/ [5619254] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:36:33 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619254/ [5619255] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:28:03 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619255/ [5619256] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619256/ [5619257] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:05:55 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619257/ [5619258] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619258/ [5619259] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/failover} time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619259/ [5619260] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619260/ [5619261] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 00:57:19 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619261/ [5619262] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619262/ [5619263] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:00:09 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619263/ [5619264] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619264/ [5619265] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619265/ [5619266] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619266/ [5619267] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619267/ [5619268] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619268/ [5619269] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619269/ [5619270] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619270/ [5619271] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619271/ [5619272] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619272/ [5619273] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:36:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619273/ [5619275] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mgr} time: 00:17:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619275/ [5619276] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619276/ [5619277] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:10:32 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619277/ [5619278] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619278/ [5619279] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:44:19 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619279/ [5619280] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:30:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619280/ [5619281] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619281/ [5619282] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619282/ [5619283] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:26 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619283/ [5619284] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619284/ [5619285] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:22:03 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619285/ [5619286] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619286/ [5619288] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:17:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619288/ [5619289] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619289/ [5619290] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:29:13 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619290/ [5619291] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619291/ [5619292] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619292/ [5619293] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619293/ [5619294] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/insights} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619294/ [5619295] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:22 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619295/ [5619296] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619296/ [5619297] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619297/ [5619298] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619298/ [5619299] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:36:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619299/ [5619301] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619301/ [5619302] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619302/ [5619303] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619303/ [5619304] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619304/ [5619305] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619305/ [5619306] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619306/ [5619307] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619307/ [5619308] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 02:17:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619308/ [5619309] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619309/ [5619310] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619310/ [5619311] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619311/ [5619312] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619312/ [5619313] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619313/ [5619314] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619314/ [5619315] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:30 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619315/ [5619316] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619316/ [5619317] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:54:32 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619317/ [5619318] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619318/ [5619319] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:41:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619319/ [5619320] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619320/ [5619321] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619321/ [5619322] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:00 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619322/ [5619323] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619323/ [5619324] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:26:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619324/ [5619325] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:20:09 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619325/ [5619326] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619326/ [5619327] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619327/ [5619328] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:29:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619328/ [5619329] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} time: 00:47:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619329/ [5619330] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619330/ [5619331] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} time: 00:15:52 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619331/ [5619332] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619332/ [5619333] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619333/ [5619334] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619334/ [5619335] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619335/ [5619336] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:31:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619336/ [5619337] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619337/ [5619338] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619338/ [5619339] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:33:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619339/ [5619340] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619340/ [5619341] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619341/ [5619342] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619342/ [5619343] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:24:25 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619343/ [5619344] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619344/ [5619345] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619345/ [5619346] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619346/ [5619347] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:09:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619347/ [5619348] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:38 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619348/ [5619349] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619349/ [5619350] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} time: 00:50:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619350/ [5619351] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:17:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619351/ [5619352] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:38:45 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619352/ [5619354] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619354/ [5619355] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:25:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619355/ [5619356] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619356/ [5619357] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/osd} time: 03:08:07 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619357/ [5619358] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619358/ [5619359] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619359/ [5619360] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:59:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619360/ [5619361] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 01:03:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619361/ [5619362] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619362/ [5619363] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/progress} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619363/ [5619364] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619364/ [5619365] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619365/ [5619366] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619366/ [5619367] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:03 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619367/ [5619368] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619368/ [5619369] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619369/ [5619370] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:37:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619370/ [5619372] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:27:29 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619372/ [5619373] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619373/ [5619374] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619374/ [5619376] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619376/ [5619377] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619377/ [5619378] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619378/ [5619379] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:26:25 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619379/ [5619380] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/scrub} time: 01:39:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619380/ [5619381] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619381/ [5619382] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619382/ [5619383] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619383/ [5619384] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619384/ [5619385] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} time: 00:25:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619385/ [5619386] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619386/ [5619387] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:57:46 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619387/ [5619388] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:32:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619388/ [5619389] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619389/ [5619390] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:32:30 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619390/ [5619391] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619391/ [5619392] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619392/ [5619394] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:05:15 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619394/ [5619395] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:35:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619395/ [5619396] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619396/ [5619397] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/prometheus} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619397/ [5619398] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:39:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619398/ [5619399] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619399/ [5619400] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619400/ [5619401] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619401/ [5619402] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 02:27:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619402/ [5619403] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:33:11 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619403/ [5619405] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:37:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619405/ [5619406] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619406/ [5619407] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619407/ [5619408] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/crush} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619408/ [5619409] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619409/ [5619410] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:23:31 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619410/ [5619412] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619412/ [5619413] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619413/ [5619414] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619414/ [5619415] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:30:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619415/ [5619416] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619416/ [5619417] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619417/ [5619418] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:01 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619418/ [5619419] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619419/ [5619420] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619420/ [5619421] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619421/ [5619422] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619422/ [5619423] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} time: 02:03:07 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619423/ [5619424] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619424/ [5619425] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:46 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619425/ [5619426] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/snaps-few-objects} time: 00:40:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619426/ [5619427] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} time: 00:29:01 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619427/ [5619428] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619428/ [5619429] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619429/ [5619430] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619430/ [5619431] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619431/ [5619432] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619432/ [5619433] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619433/ [5619434] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619434/ [5619435] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619435/ [5619436] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:37:40 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619436/ [5619437] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619437/ [5619438] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619438/ [5619439] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619439/ [5619440] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619440/ [5619441] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:35:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619441/ [5619442] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619442/ [5619443] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619443/ [5619444] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619444/ [5619445] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619445/ [5619446] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619446/ [5619447] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619447/ [5619448] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619448/ [5619449] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619449/ [5619450] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:10 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619450/ [5619451] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619451/ [5619452] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619452/ [5619453] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619453/ [5619454] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619454/ [5619455] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:04 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619455/ [5619456] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619456/ [5619457] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619457/ [5619458] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:04 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619458/ [5619459] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:26 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619459/ [5619460] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mgr} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619460/ [5619461] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} time: 00:18:56 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619461/ [5619462] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:46 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619462/ [5619463] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:33:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619463/ [5619464] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:49:22 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619464/ [5619465] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:14:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619465/ [5619466] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619466/ [5619468] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:32 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619468/ [5619469] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/crash} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619469/ [5619470] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:16 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619470/ [5619471] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619471/ [5619472] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619472/ [5619473] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:30 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619473/ [5619474] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:24:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619474/ [5619475] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619475/ [5619476] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619476/ [5619477] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:14:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619477/ [5619478] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619478/ [5619479] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619479/ [5619480] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619480/ [5619481] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619481/ [5619482] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619482/ [5619483] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:23:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619483/ [5619484] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:22:00 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619484/ [5619486] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619486/ [5619487] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:33 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619487/ [5619488] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619488/ [5619489] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:25:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619489/ [5619490] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:31:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619490/ [5619491] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619491/ [5619492] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619492/ [5619493] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619493/ [5619494] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619494/ [5619495] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 00:51:35 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619495/ [5619496] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619496/ [5619497] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:51:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619497/ [5619498] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619498/ [5619499] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619499/ [5619500] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619500/ [5619501] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:35:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619501/ [5619502] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619502/ [5619503] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/failover} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619503/ [5619504] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619504/ [5619505] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619505/ [5619506] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619506/ [5619507] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619507/ [5619508] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619508/ [5619509] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619509/ [5619510] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619510/ [5619511] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619511/ [5619512] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619512/ [5619513] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619513/ [5619514] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:41:31 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619514/ [5619515] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619515/ [5619517] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619517/ [5619518] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619518/ [5619519] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:20:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619519/ [5619520] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619520/ [5619521] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619521/ [5619522] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619522/ [5619523] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619523/ [5619524] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619524/ [5619525] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619525/ [5619526] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619526/ [5619527] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:31:38 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619527/ [5619528] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619528/ [5619529] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:17 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619529/ [5619531] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619531/ [5619532] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619532/ [5619533] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619533/ [5619534] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:13 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619534/ [5619535] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619535/ [5619536] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619536/ [5619537] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619537/ [5619538] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619538/ [5619539] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/insights} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619539/ [5619540] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619540/ [5619541] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:08:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619541/ [5619542] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:32:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619542/ [5619544] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:32 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619544/ [5619545] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619545/ [5619546] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619546/ [5619547] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:29:05 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619547/ [5619548] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619548/ [5619549] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:00:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619549/ [5619550] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 05:06:37 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619550/ [5619551] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619551/ [5619552] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619552/ [5619553] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619553/ [5619554] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:20:16 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619554/ [5619556] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619556/ [5619557] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619557/ [5619558] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:25:43 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619558/ [5619559] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619559/ [5619560] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:29 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619560/ [5619561] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:22:53 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619561/ [5619562] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619562/ [5619563] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/scrub} time: 01:39:13 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619563/ [5619564] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619564/ [5619565] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} time: 00:26:12 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619565/ [5619566] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619566/ [5619567] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619567/ [5619568] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:20 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619568/ [5619569] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619569/ [5619570] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:40:54 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619570/ [5619571] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:14 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619571/ [5619572] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619572/ [5619573] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:17 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619573/ [5619574] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2020-11-13_07:01:02-rados-master-distro-basic-smithi/5619574/