2021-11-21T03:33:09.320 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-21T03:33:09.322 INFO:teuthology.results:subset: '4238/99999' 2021-11-21T03:33:09.322 INFO:teuthology.results:seed: '681' 2021-11-21T07:07:02.731 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-21T07:07:02.826 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-11-21T12:47:32.090 INFO:teuthology.results:Tests finished! gathering results... 2021-11-21T12:48:08.166 INFO:scrape:Found 394 jobs 2021-11-21T12:48:10.312 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.314 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.315 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.315 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:10.353 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.355 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.355 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.356 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:10.394 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.397 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:10.438 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.440 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.441 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.441 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:10.479 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.481 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.481 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.482 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:10.523 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.524 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.525 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.525 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:10.566 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.6-632-ge88dddee (e88dddeed2222c179fd5ab7fa294fa79140ca503) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7efe7f545102] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x56133b2a8f66] 2021-11-21T12:48:10.568 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2021-11-21T05:35:28.322 INFO:teuthology.orchestra.run.smithi090.stdout:} , 2021-11-21T05:35:28.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-21T12:48:10.568 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:10.692 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-11-21T05:36:11.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com , 2021-11-21T05:36:11.615 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-21T12:48:10.569 WARNING:scrape:Ignoring malparsed backtrace: 2021-11-21T05:36:30.193 INFO:teuthology.task.internal:Duration was 1269.063143 seconds , 2021-11-21T05:36:30.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2021-11-21T05:36:30.274 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-21T12:48:12.003 INFO:scrape:Found 7 distinct failure reasons 2021-11-21T12:48:12.005 INFO:scrape:Failure: Command failed on smithi171 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2021-11-21T12:48:12.005 INFO:scrape:8 jobs: ['6517750', '6517486', '6517684', '6517551', '6517537', '6517731', '6517814', '6517623'] 2021-11-21T12:48:12.006 INFO:scrape:suites intersection: [] 2021-11-21T12:48:12.006 INFO:scrape:suites union: ['0-centos_8.stream_container_tools', '1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'clusters/{2-node-mgr}', 'debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-comp-snappy}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2021-11-21T12:48:12.007 INFO:scrape: 2021-11-21T12:48:12.007 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi062 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c896cb3eedfe0e0bbdefa0f787f43d4efedda954 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-11-21T12:48:12.008 INFO:scrape:2 jobs: ['6517543', '6517742'] 2021-11-21T12:48:12.008 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0', 'task/test_e2e}'] 2021-11-21T12:48:12.008 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0', 'task/test_e2e}'] 2021-11-21T12:48:12.009 INFO:scrape: 2021-11-21T12:48:12.009 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2021-11-21T12:48:12.010 INFO:scrape:2 jobs: ['6517588', '6517747'] 2021-11-21T12:48:12.010 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-11-21T12:48:12.011 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-11-21T12:48:12.011 INFO:scrape: 2021-11-21T12:48:12.011 INFO:scrape:Failure: list index out of range 2021-11-21T12:48:12.012 INFO:scrape:2 jobs: ['6517755', '6517554'] 2021-11-21T12:48:12.012 INFO:scrape:suites intersection: ['rados/cephadm/osds/2-ops/rm-zap-flag'] 2021-11-21T12:48:12.013 INFO:scrape:suites union: ['rados/cephadm/osds/2-ops/rm-zap-flag'] 2021-11-21T12:48:12.013 INFO:scrape: 2021-11-21T12:48:12.013 INFO:scrape:Failure: Command failed on smithi109 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e88dddeed2222c179fd5ab7fa294fa79140ca503 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1294d810-4a9c-11ec-8c2c-001a4aab830c -- ceph mon dump -f json' 2021-11-21T12:48:12.014 INFO:scrape:2 jobs: ['6517874', '6517726'] 2021-11-21T12:48:12.014 INFO:scrape:suites intersection: ['fixed-2', 'msgr/async-v1only'] 2021-11-21T12:48:12.015 INFO:scrape:suites union: ['1-start', '2-thrash', '3-tasks/rados_api_tests', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr/async-v1only', 'rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'root}', 'start', 'tasks/rados_python}'] 2021-11-21T12:48:12.015 INFO:scrape: 2021-11-21T12:48:12.015 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2021-11-21T12:48:12.016 INFO:scrape:1 jobs: ['6517669'] 2021-11-21T12:48:12.016 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{rhel_8}}'] 2021-11-21T12:48:12.017 INFO:scrape: 2021-11-21T12:48:12.017 INFO:scrape:Failure: reached maximum tries (800) after waiting for 4800 seconds 2021-11-21T12:48:12.017 INFO:scrape:1 jobs: ['6517809'] 2021-11-21T12:48:12.018 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-radosbench}'] 2021-11-21T12:48:12.018 INFO:scrape: 2021-11-21T12:48:12.030 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/ failed: 18 dead: 0 running: 0 waiting: 0 queued: 0 passed: 376 Fail ================================================================= [6517486] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517486/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517486/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d7b4951b67c4fab94a51d372a96a8aa Command failed on smithi173 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517537] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:03:30 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517537/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e601dfaa08a4844b872d74e46fa6004 Command failed on smithi148 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517543] rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:31:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517543/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517543/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ed6f3ae96614bea96d9f8a9a18513be Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi062 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c896cb3eedfe0e0bbdefa0f787f43d4efedda954 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6517551] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517551/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517551/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aeb685c1a0114a7381a0a732bb7afce0 Command failed on smithi098 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517554] rados/cephadm/osds/2-ops/rm-zap-flag ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517554/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517554/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec13fbdfcb2c47efbdac7a9c8e5dfba9 list index out of range [6517588] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:42:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517588/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517588/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a92ab92aca204ba0bb9669bff9dcd55b Command failed (workunit test rados/test.sh) on smithi092 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c896cb3eedfe0e0bbdefa0f787f43d4efedda954 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6517623] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517623/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517623/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28c394806873413c849a36f713daeace Command failed on smithi175 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517669] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:21:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517669/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517669/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [6517684] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517684/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517684/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e1e2e0fb3684560bc609387966c1720 Command failed on smithi155 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517726] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517726/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517726/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32906f436d094e8ea80f078b80974be7 Command failed on smithi157 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e88dddeed2222c179fd5ab7fa294fa79140ca503 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 50b42fbc-4a90-11ec-8c2c-001a4aab830c -- ceph mon dump -f json' [6517731] rados/dashboard/{centos_8.2_container_tools_3.0 clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:03:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517731/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517731/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce2a4c696f5340d19e9b2f73a4870066 Command failed on smithi033 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517742] rados/cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517742/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517742/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a68c85bb6a874385bd098f520eb53a0f Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi039 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c896cb3eedfe0e0bbdefa0f787f43d4efedda954 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6517747] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:43:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517747/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8086ce27ae6b4e5a95d60d03274868a5 Command failed (workunit test rados/test.sh) on smithi064 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c896cb3eedfe0e0bbdefa0f787f43d4efedda954 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6517750] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517750/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517750/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f1a7ca2ba7cb49f2a462c7ff247deabe Command failed on smithi171 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517755] rados/cephadm/osds/2-ops/rm-zap-flag ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517755/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517755/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b4f8e962bd6848aba42d0ffc778f332a list index out of range [6517809] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 03:17:14 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517809/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517809/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f22d2cd6a7e4434c8f4a57eb335167eb reached maximum tries (800) after waiting for 4800 seconds [6517814] rados/cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517814/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b563a902613f488e9488e368265ef872 Command failed on smithi125 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6517874] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517874/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517874/ sentry: https://sentry.ceph.com/organizations/ceph/?query=142f02ca0ad44413b85cb97ced4a7c14 Command failed on smithi109 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e88dddeed2222c179fd5ab7fa294fa79140ca503 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1294d810-4a9c-11ec-8c2c-001a4aab830c -- ceph mon dump -f json' Pass ================================================================= [6517484] rados/cephadm/smoke/{distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517484/ [6517485] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:15:17 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517485/ [6517487] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517487/ [6517488] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:40:22 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517488/ [6517489] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517489/ [6517490] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/failover} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517490/ [6517491] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517491/ [6517492] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517492/ [6517493] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} time: 04:33:57 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517493/ [6517494] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:46:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517494/ [6517495] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517495/ [6517496] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} time: 00:33:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517496/ [6517497] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 02:04:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517497/ [6517498] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517498/ [6517499] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:35:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517499/ [6517500] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517500/ [6517501] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517501/ [6517502] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:46:57 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517502/ [6517503] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:40:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517503/ [6517504] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517504/ [6517505] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517505/ [6517506] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:44:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517506/ [6517507] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:31:12 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517507/ [6517508] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:29:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517508/ [6517509] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517509/ [6517510] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 01:50:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517510/ [6517511] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/nfs-ingress2 3-final} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517511/ [6517512] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517512/ [6517513] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517513/ [6517514] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:40:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517514/ [6517515] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:36:21 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517515/ [6517516] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:17:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517516/ [6517517] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:14:40 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517517/ [6517518] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517518/ [6517519] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} time: 00:31:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517519/ [6517520] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:28:26 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517520/ [6517521] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517521/ [6517522] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517522/ [6517523] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517523/ [6517524] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517524/ [6517525] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs 3-final} time: 00:17:26 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517525/ [6517526] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517526/ [6517527] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517527/ [6517528] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:23:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517528/ [6517529] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517529/ [6517530] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:31:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517530/ [6517531] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517531/ [6517532] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517532/ [6517533] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517533/ [6517534] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517534/ [6517535] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:33:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517535/ [6517536] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs2 3-final} time: 00:16:38 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517536/ [6517538] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517538/ [6517539] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:53:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517539/ [6517540] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:29 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517540/ [6517541] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:45:36 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517541/ [6517542] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517542/ [6517544] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517544/ [6517545] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:30:12 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517545/ [6517546] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:14 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517546/ [6517547] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517547/ [6517548] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517548/ [6517549] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_rw} time: 00:09:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517549/ [6517550] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517550/ [6517552] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517552/ [6517553] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517553/ [6517555] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517555/ [6517556] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517556/ [6517557] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517557/ [6517558] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 01:03:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517558/ [6517559] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517559/ [6517560] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517560/ [6517561] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517561/ [6517562] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517562/ [6517563] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517563/ [6517564] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517564/ [6517565] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:47:24 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517565/ [6517566] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517566/ [6517567] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:20:18 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517567/ [6517568] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517568/ [6517569] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/rgw-ingress 3-final} time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517569/ [6517570] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:25:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517570/ [6517571] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:25:43 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517571/ [6517572] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517572/ [6517573] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4M_rand_write} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517573/ [6517574] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517574/ [6517575] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:21:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517575/ [6517576] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517576/ [6517577] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:34:14 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517577/ [6517578] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:36:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517578/ [6517579] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/rgw 3-final} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517579/ [6517580] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:34:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517580/ [6517581] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517581/ [6517582] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517582/ [6517583] rados/cephadm/smoke/{distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517583/ [6517584] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517584/ [6517585] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517585/ [6517586] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517586/ [6517587] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517587/ [6517589] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 1-start 2-services/basic 3-final} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517589/ [6517590] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:36:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517590/ [6517591] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:38:25 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517591/ [6517592] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517592/ [6517593] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517593/ [6517594] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_rand_read} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517594/ [6517595] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 01:23:14 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517595/ [6517596] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517596/ [6517597] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517597/ [6517598] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517598/ [6517599] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:26 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517599/ [6517600] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:33:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517600/ [6517601] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:24:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517601/ [6517602] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:22:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517602/ [6517603] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517603/ [6517604] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517604/ [6517605] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:46 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517605/ [6517606] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517606/ [6517607] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517607/ [6517608] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517608/ [6517609] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517609/ [6517610] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517610/ [6517611] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/client-keyring 3-final} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517611/ [6517612] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:26:11 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517612/ [6517613] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517613/ [6517614] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517614/ [6517615] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:19:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517615/ [6517616] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517616/ [6517617] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517617/ [6517618] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517618/ [6517619] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517619/ [6517620] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/iscsi 3-final} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517620/ [6517621] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_seq_read} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517621/ [6517622] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:07:51 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517622/ [6517624] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517624/ [6517625] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:21:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517625/ [6517626] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:53:54 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517626/ [6517627] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517627/ [6517628] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517628/ [6517629] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:16:32 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517629/ [6517630] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517630/ [6517631] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517631/ [6517632] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:30:17 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517632/ [6517633] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/mirror 3-final} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517633/ [6517634] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517634/ [6517635] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517635/ [6517636] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:52:12 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517636/ [6517637] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} time: 00:28:01 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517637/ [6517638] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 01:14:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517638/ [6517639] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517639/ [6517640] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517640/ [6517641] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/prometheus} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517641/ [6517642] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:23:22 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517642/ [6517643] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517643/ [6517644] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517644/ [6517645] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517645/ [6517646] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_rand_read} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517646/ [6517647] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:27 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517647/ [6517648] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517648/ [6517649] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517649/ [6517650] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:46:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517650/ [6517651] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517651/ [6517652] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:21:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517652/ [6517653] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517653/ [6517654] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:39:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517654/ [6517655] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517655/ [6517656] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517656/ [6517657] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517657/ [6517658] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:18:22 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517658/ [6517659] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:43:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517659/ [6517660] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/nfs-ingress 3-final} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517660/ [6517661] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517661/ [6517662] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517662/ [6517663] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:42:24 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517663/ [6517664] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517664/ [6517665] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517665/ [6517666] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 01:48:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517666/ [6517667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517667/ [6517668] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:45 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517668/ [6517670] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517670/ [6517671] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517671/ [6517672] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517672/ [6517673] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:18:41 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517673/ [6517674] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:28:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517674/ [6517675] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517675/ [6517676] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:26:00 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517676/ [6517677] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:41:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517677/ [6517678] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517678/ [6517679] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517679/ [6517680] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/nfs-ingress2 3-final} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517680/ [6517681] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:34:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517681/ [6517682] rados/cephadm/smoke/{distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517682/ [6517683] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517683/ [6517685] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517685/ [6517686] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517686/ [6517687] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:40:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517687/ [6517688] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:06:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517688/ [6517689] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 1-start 2-services/nfs 3-final} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517689/ [6517690] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 04:54:38 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517690/ [6517691] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 01:00:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517691/ [6517692] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:37:14 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517692/ [6517693] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_write} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517693/ [6517694] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:33:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517694/ [6517695] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517695/ [6517696] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517696/ [6517697] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:41:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517697/ [6517698] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517698/ [6517699] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:34:10 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517699/ [6517700] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:40 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517700/ [6517701] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517701/ [6517702] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517702/ [6517703] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517703/ [6517704] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:38:17 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517704/ [6517705] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517705/ [6517706] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517706/ [6517707] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517707/ [6517708] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517708/ [6517709] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517709/ [6517710] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:43:54 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517710/ [6517711] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517711/ [6517712] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/nfs2 3-final} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517712/ [6517713] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:30:52 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517713/ [6517714] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517714/ [6517715] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517715/ [6517716] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517716/ [6517717] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_omap_write} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517717/ [6517718] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:33:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517718/ [6517719] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517719/ [6517720] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517720/ [6517721] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517721/ [6517722] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/rgw-ingress 3-final} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517722/ [6517723] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517723/ [6517724] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517724/ [6517725] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:20:25 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517725/ [6517727] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:34:32 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517727/ [6517728] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517728/ [6517729] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517729/ [6517730] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517730/ [6517732] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:07:20 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517732/ [6517733] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:24:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517733/ [6517734] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517734/ [6517735] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517735/ [6517736] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:55:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517736/ [6517737] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517737/ [6517738] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517738/ [6517739] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw 3-final} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517739/ [6517740] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:46:17 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517740/ [6517741] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517741/ [6517743] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517743/ [6517744] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517744/ [6517745] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:00 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517745/ [6517746] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/sample_fio} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517746/ [6517748] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517748/ [6517749] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517749/ [6517751] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517751/ [6517752] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517752/ [6517753] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517753/ [6517754] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517754/ [6517756] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/failover} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517756/ [6517757] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} time: 00:32:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517757/ [6517758] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517758/ [6517759] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:24:40 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517759/ [6517760] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:54:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517760/ [6517761] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517761/ [6517762] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517762/ [6517763] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:29:27 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517763/ [6517764] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517764/ [6517765] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 01:10:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517765/ [6517766] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517766/ [6517767] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517767/ [6517768] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517768/ [6517769] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517769/ [6517770] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/sample_radosbench} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517770/ [6517771] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:43:03 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517771/ [6517772] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517772/ [6517773] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517773/ [6517774] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:05:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517774/ [6517775] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:49:19 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517775/ [6517776] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:32:29 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517776/ [6517777] rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 1-start 2-services/client-keyring 3-final} time: 00:14:23 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517777/ [6517778] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517778/ [6517779] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:24:32 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517779/ [6517780] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517780/ [6517781] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:38:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517781/ [6517782] rados/cephadm/smoke/{distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517782/ [6517783] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517783/ [6517784] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517784/ [6517785] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517785/ [6517786] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517786/ [6517787] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517787/ [6517788] rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 1-start 2-services/iscsi 3-final} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517788/ [6517789] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517789/ [6517790] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:22:27 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517790/ [6517791] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:23:01 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517791/ [6517792] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:39:41 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517792/ [6517793] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/insights} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517793/ [6517794] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517794/ [6517795] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:53:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517795/ [6517796] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/cosbench_64K_read_write} time: 00:18:57 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517796/ [6517797] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517797/ [6517798] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:38:41 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517798/ [6517799] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517799/ [6517800] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:36:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517800/ [6517801] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:29:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517801/ [6517802] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517802/ [6517803] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517803/ [6517804] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517804/ [6517805] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517805/ [6517806] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517806/ [6517807] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517807/ [6517808] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 1-start 2-services/mirror 3-final} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517808/ [6517810] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517810/ [6517811] rados/cephadm/smoke/{distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:16 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517811/ [6517812] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:21 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517812/ [6517813] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517813/ [6517815] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517815/ [6517816] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517816/ [6517817] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_write} time: 00:29:26 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517817/ [6517818] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517818/ [6517819] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517819/ [6517820] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517820/ [6517821] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:29:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517821/ [6517822] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:52 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517822/ [6517823] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517823/ [6517824] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:54 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517824/ [6517825] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517825/ [6517826] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:23:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517826/ [6517827] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517827/ [6517828] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517828/ [6517829] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:29 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517829/ [6517830] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:20 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517830/ [6517831] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:12:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517831/ [6517832] rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:36:36 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517832/ [6517833] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:42:13 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517833/ [6517834] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} time: 00:27:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517834/ [6517835] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517835/ [6517836] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-services/nfs-ingress 3-final} time: 00:21:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517836/ [6517837] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517837/ [6517838] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517838/ [6517839] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:26:46 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517839/ [6517840] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517840/ [6517841] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517841/ [6517842] rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517842/ [6517843] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517843/ [6517844] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/nfs-ingress2 3-final} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517844/ [6517845] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517845/ [6517846] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517846/ [6517847] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:19:44 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517847/ [6517848] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517848/ [6517849] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:43 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517849/ [6517850] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517850/ [6517851] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517851/ [6517852] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517852/ [6517853] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517853/ [6517854] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517854/ [6517855] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517855/ [6517856] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:33:06 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517856/ [6517857] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:25:36 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517857/ [6517858] rados/cephadm/smoke/{distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517858/ [6517859] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:38:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517859/ [6517860] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517860/ [6517861] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517861/ [6517862] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs 3-final} time: 00:17:07 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517862/ [6517863] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:20:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517863/ [6517864] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517864/ [6517865] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} time: 00:30:22 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517865/ [6517866] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:30:58 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517866/ [6517867] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:29 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517867/ [6517868] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517868/ [6517869] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517869/ [6517870] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:33:53 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517870/ [6517871] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517871/ [6517872] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:49:37 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517872/ [6517873] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517873/ [6517875] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 01:03:43 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517875/ [6517876] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:24:20 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517876/ [6517877] rados/cephadm/smoke/{distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2021-11-21_03:31:04-rados-pacific-distro-default-smithi/6517877/