2020-11-09T07:24:49.515 INFO:root:teuthology version: 1.0.0-41b569f 2020-11-09T07:24:49.516 INFO:teuthology.results:subset: '8/100000' 2020-11-09T07:24:49.516 INFO:teuthology.results:seed: '7938' 2020-11-09T11:45:34.651 INFO:root:teuthology version: 1.0.0-41b569f 2020-11-09T11:45:34.705 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-09T16:57:45.907 INFO:teuthology.results:Tests finished! gathering results... 2020-11-09T16:58:29.474 INFO:scrape:Found 367 jobs 2020-11-09T16:58:35.788 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:35.790 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:35.790 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:35.791 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:35.899 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:35.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:35.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:35.902 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:36.008 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:36.010 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:36.011 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:36.011 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:36.123 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:36.125 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:36.126 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:36.126 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:36.253 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:36.255 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:36.255 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:36.256 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:36.360 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:36.362 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:36.362 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:36.363 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:36.464 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:36.466 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:36.466 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:36.467 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:36.574 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-6993-g4052b11f (4052b11f18d10cf1b0e41954ce4f81a970ff3e65) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fafce853a94] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1306) [0x56447f8b50b6] 2020-11-09T16:58:36.576 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:48:28.588 INFO:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2020-11-09T10:48:28.893 INFO:teuthology.orchestra.run.smithi006.stdout: , dumped all 2020-11-09T16:58:36.576 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:49:30.803 INFO:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 , 2020-11-09T10:49:30.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com , 2020-11-09T10:49:30.878 INFO:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-09T16:58:36.577 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-09T10:51:36.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp , 2020-11-09T10:51:36.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer , 2020-11-09T10:51:36.558 INFO:teuthology.task.internal:Duration was 681.480885 seconds 2020-11-09T16:58:37.936 INFO:scrape:Found 9 distinct failure reasons 2020-11-09T16:58:37.937 INFO:scrape:Failure: Command failed on smithi066 with status 5: 'sudo systemctl stop ceph-41b2be94-2277-11eb-a2af-001a4aab830c@mon.a' 2020-11-09T16:58:37.938 INFO:scrape:3 jobs: ['5605208', '5605253', '5605157'] 2020-11-09T16:58:37.938 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-11-09T16:58:37.939 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_8.0}', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-11-09T16:58:37.939 INFO:scrape: 2020-11-09T16:58:37.939 INFO:scrape:Failure: "2020-11-09T13:40:46.559748+0000 osd.9 (osd.9) 84 : cluster [ERR] 5.14 deep-scrub : stat mismatch, got 4/4 objects, 0/0 clones, 0/0 dirty, 0/0 omap, 0/0 pinned, 4/4 hit_set_archive, 0/0 whiteouts, 7061/0 bytes, 0/0 manifest objects, 7061/7061 hit_set_archive bytes." in cluster log 2020-11-09T16:58:37.939 INFO:scrape:1 jobs: ['5605192'] 2020-11-09T16:58:37.940 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'mon_election/connectivity', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2020-11-09T16:58:37.940 INFO:scrape: 2020-11-09T16:58:37.940 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2020-11-09T16:58:37.941 INFO:scrape:1 jobs: ['5605244'] 2020-11-09T16:58:37.941 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2020-11-09T16:58:37.941 INFO:scrape: 2020-11-09T16:58:37.942 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2020-11-09T16:58:37.942 INFO:scrape:3 jobs: ['5605322', '5605102', '5605356'] 2020-11-09T16:58:37.942 INFO:scrape:suites intersection: ['rados', 'rados/monthrash/{ceph', 'workloads/rados_mon_workunits}'] 2020-11-09T16:58:37.943 INFO:scrape:suites union: ['clusters/3-mons', 'clusters/9-mons', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/filestore-xfs', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'thrashers/sync', 'thrashers/sync-many', 'workloads/rados_mon_workunits}'] 2020-11-09T16:58:37.943 INFO:scrape: 2020-11-09T16:58:37.943 INFO:scrape:Failure: Command failed (workunit test rados/test_python.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' 2020-11-09T16:58:37.944 INFO:scrape:1 jobs: ['5605156'] 2020-11-09T16:58:37.944 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_python}'] 2020-11-09T16:58:37.944 INFO:scrape: 2020-11-09T16:58:37.944 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2020-11-09T16:58:37.945 INFO:scrape:1 jobs: ['5605141'] 2020-11-09T16:58:37.945 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'task/test_cephadm}'] 2020-11-09T16:58:37.945 INFO:scrape: 2020-11-09T16:58:37.946 INFO:scrape:Timeout 120 running ceph --cluster ceph osd last-stat-seq osd.2 2020-11-09T16:58:37.946 INFO:scrape:1 jobs: ['5605014'] 2020-11-09T16:58:37.946 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/max-pg-per-osd.from-replica', 'supported-random-distro$/{centos_8}}'] 2020-11-09T16:58:37.946 INFO:scrape: 2020-11-09T16:58:37.947 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-11-09T16:58:37.947 INFO:scrape:1 jobs: ['5605229'] 2020-11-09T16:58:37.947 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}'] 2020-11-09T16:58:37.948 INFO:scrape: 2020-11-09T16:58:37.948 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-11-09T16:58:37.948 INFO:scrape:2 jobs: ['5605296', '5605118'] 2020-11-09T16:58:37.948 INFO:scrape:suites intersection: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_8.0}', 'fixed-2', 'mon_election/classic}', 'rados/cephadm/upgrade/{1-start'] 2020-11-09T16:58:37.949 INFO:scrape:suites union: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_8.0}', 'fixed-2', 'mon_election/classic}', 'rados/cephadm/upgrade/{1-start'] 2020-11-09T16:58:37.949 INFO:scrape: 2020-11-09T16:58:37.963 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/ failed: 14 dead: 0 running: 0 waiting: 0 queued: 0 passed: 353 Fail ================================================================= [5605014] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605014/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605014/ sentry: https://sentry.ceph.com/ceph/sepia/?query=356e02da985a45d1934ba3fea270876a Command failed on smithi052 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2' [5605102] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:17:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605102/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605102/ sentry: https://sentry.ceph.com/ceph/sepia/?query=5d921f88815e4a429aaf8756274aa463 Command failed (workunit test mon/caps.sh) on smithi089 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5605118] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605118/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605118/ sentry: https://sentry.ceph.com/ceph/sepia/?query=8bd52b30af204936a25a044798bb2293 reached maximum tries (180) after waiting for 180 seconds [5605141] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605141/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605141/ sentry: https://sentry.ceph.com/ceph/sepia/?query=4febc1498b2d47bfbadaf55e3240f372 Command failed (workunit test cephadm/test_cephadm.sh) on smithi023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5605156] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} ----------------------------------------------------------------- time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605156/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605156/ sentry: https://sentry.ceph.com/ceph/sepia/?query=63d5023256424205a43400cf79db1bcc Command failed (workunit test rados/test_python.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh' [5605157] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:07:01 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605157/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605157/ sentry: https://sentry.ceph.com/ceph/sepia/?query=6cfe77b4f7374a1ea961760a34c64962 Command failed on smithi005 with status 5: 'sudo systemctl stop ceph-f13b104a-2273-11eb-a2af-001a4aab830c@mon.a' [5605192] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 05:07:38 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605192/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605192/ "2020-11-09T13:40:46.559748+0000 osd.9 (osd.9) 84 : cluster [ERR] 5.14 deep-scrub : stat mismatch, got 4/4 objects, 0/0 clones, 0/0 dirty, 0/0 omap, 0/0 pinned, 4/4 hit_set_archive, 0/0 whiteouts, 7061/0 bytes, 0/0 manifest objects, 7061/7061 hit_set_archive bytes." in cluster log [5605208] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605208/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605208/ sentry: https://sentry.ceph.com/ceph/sepia/?query=04fca54bd12e456688a321b586514e7a Command failed on smithi066 with status 5: 'sudo systemctl stop ceph-41b2be94-2277-11eb-a2af-001a4aab830c@mon.a' [5605229] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605229/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605229/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5605244] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605244/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605244/ sentry: https://sentry.ceph.com/ceph/sepia/?query=5ecf8cbdf4fe4fe5941ee8cdc0c5621d Command failed (workunit test cephadm/test_adoption.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5605253] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:06:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605253/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605253/ sentry: https://sentry.ceph.com/ceph/sepia/?query=b92d1c5fd04547cda92e2d6009c83d5a Command failed on smithi116 with status 5: 'sudo systemctl stop ceph-32a060f2-227a-11eb-a2af-001a4aab830c@mon.a' [5605296] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:18:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605296/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605296/ sentry: https://sentry.ceph.com/ceph/sepia/?query=c608c2a859a648849b4f00a910e438f7 reached maximum tries (180) after waiting for 180 seconds [5605322] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:20:15 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605322/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605322/ sentry: https://sentry.ceph.com/ceph/sepia/?query=96acd77d06304dbfb30c9877d6ff446b Command failed (workunit test mon/caps.sh) on smithi016 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5605356] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:14:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605356/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605356/ sentry: https://sentry.ceph.com/ceph/sepia/?query=d1d6005329ed470cb48c1ed10d3c5253 Command failed (workunit test mon/caps.sh) on smithi003 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4052b11f18d10cf1b0e41954ce4f81a970ff3e65 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' Pass ================================================================= [5604991] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604991/ [5604992] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604992/ [5604993] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604993/ [5604994] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604994/ [5604995] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604995/ [5604996] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604996/ [5604997] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604997/ [5604998] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604998/ [5604999] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5604999/ [5605000] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605000/ [5605001] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} time: 00:26:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605001/ [5605002] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:27:39 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605002/ [5605003] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605003/ [5605004] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:34 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605004/ [5605005] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605005/ [5605006] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605006/ [5605007] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:10:01 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605007/ [5605008] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605008/ [5605009] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605009/ [5605010] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:47 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605010/ [5605011] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:13:02 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605011/ [5605012] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605012/ [5605013] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605013/ [5605015] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:25:25 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605015/ [5605016] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605016/ [5605017] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605017/ [5605018] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605018/ [5605019] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605019/ [5605020] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605020/ [5605021] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605021/ [5605022] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:27:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605022/ [5605023] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605023/ [5605024] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605024/ [5605025] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605025/ [5605026] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:52 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605026/ [5605027] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605027/ [5605028] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605028/ [5605029] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605029/ [5605030] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_api_tests} time: 00:37:46 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605030/ [5605031] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605031/ [5605032] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:19:12 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605032/ [5605033] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:38:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605033/ [5605034] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605034/ [5605035] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605035/ [5605036] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605036/ [5605037] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605037/ [5605038] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:38:56 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605038/ [5605039] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/failover} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605039/ [5605040] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605040/ [5605041] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605041/ [5605042] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605042/ [5605043] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605043/ [5605044] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605044/ [5605045] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605045/ [5605046] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605046/ [5605047] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605047/ [5605048] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605048/ [5605049] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605049/ [5605050] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:40 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605050/ [5605051] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605051/ [5605052] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605052/ [5605053] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605053/ [5605054] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:30:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605054/ [5605055] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:30:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605055/ [5605056] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605056/ [5605057] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605057/ [5605058] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:05:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605058/ [5605059] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605059/ [5605060] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605060/ [5605061] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605061/ [5605062] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605062/ [5605063] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:21:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605063/ [5605064] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:25:02 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605064/ [5605065] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605065/ [5605066] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605066/ [5605067] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:51:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605067/ [5605068] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605068/ [5605069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:45:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605069/ [5605070] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605070/ [5605071] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:05:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605071/ [5605072] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:23:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605072/ [5605073] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605073/ [5605074] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/insights} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605074/ [5605075] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605075/ [5605076] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605076/ [5605077] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/valgrind} time: 02:18:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605077/ [5605078] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605078/ [5605079] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:44:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605079/ [5605080] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605080/ [5605081] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605081/ [5605082] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605082/ [5605083] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605083/ [5605084] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605084/ [5605085] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605085/ [5605086] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:12 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605086/ [5605087] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:05:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605087/ [5605088] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:29:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605088/ [5605089] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605089/ [5605090] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605090/ [5605091] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:35:19 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605091/ [5605092] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605092/ [5605093] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605093/ [5605094] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:26:05 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605094/ [5605095] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605095/ [5605096] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:34:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605096/ [5605097] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:05:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605097/ [5605098] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 02:33:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605098/ [5605099] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605099/ [5605100] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605100/ [5605101] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605101/ [5605103] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605103/ [5605104] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605104/ [5605105] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:41:47 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605105/ [5605106] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605106/ [5605107] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:34 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605107/ [5605108] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605108/ [5605109] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605109/ [5605110] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:45:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605110/ [5605111] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605111/ [5605112] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605112/ [5605113] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605113/ [5605114] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605114/ [5605115] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605115/ [5605116] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605116/ [5605117] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:38 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605117/ [5605119] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605119/ [5605120] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605120/ [5605121] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605121/ [5605122] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605122/ [5605123] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:16:15 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605123/ [5605124] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605124/ [5605125] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605125/ [5605126] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605126/ [5605127] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:19:40 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605127/ [5605128] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605128/ [5605129] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605129/ [5605130] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605130/ [5605131] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605131/ [5605132] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605132/ [5605133] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605133/ [5605134] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605134/ [5605135] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:07 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605135/ [5605136] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605136/ [5605137] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:18:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605137/ [5605138] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:08:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605138/ [5605139] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605139/ [5605140] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/snaps-few-objects} time: 00:25:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605140/ [5605142] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:39 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605142/ [5605143] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605143/ [5605144] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/progress} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605144/ [5605145] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:54 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605145/ [5605146] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605146/ [5605147] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605147/ [5605148] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605148/ [5605149] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605149/ [5605150] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/valgrind} time: 00:50:21 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605150/ [5605151] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605151/ [5605152] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605152/ [5605153] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605153/ [5605154] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605154/ [5605155] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605155/ [5605158] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605158/ [5605159] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605159/ [5605160] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605160/ [5605161] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605161/ [5605162] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/scrub} time: 01:36:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605162/ [5605163] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:22:00 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605163/ [5605164] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:06:03 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605164/ [5605165] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605165/ [5605166] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605166/ [5605167] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 00:58:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605167/ [5605168] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:10:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605168/ [5605169] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605169/ [5605170] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605170/ [5605171] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605171/ [5605172] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605172/ [5605173] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605173/ [5605174] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605174/ [5605175] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605175/ [5605176] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:16:06 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605176/ [5605177] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605177/ [5605178] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605178/ [5605179] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605179/ [5605180] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605180/ [5605181] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:30:15 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605181/ [5605182] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:12 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605182/ [5605183] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/lockdep} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605183/ [5605184] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605184/ [5605185] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605185/ [5605186] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605186/ [5605187] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605187/ [5605188] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:35:13 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605188/ [5605189] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:37 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605189/ [5605190] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605190/ [5605191] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605191/ [5605193] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:38:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605193/ [5605194] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:21:00 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605194/ [5605195] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:20:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605195/ [5605196] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605196/ [5605197] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605197/ [5605198] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 01:00:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605198/ [5605199] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605199/ [5605200] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605200/ [5605201] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605201/ [5605202] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605202/ [5605203] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605203/ [5605204] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605204/ [5605205] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:48:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605205/ [5605206] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:04:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605206/ [5605207] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:23:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605207/ [5605209] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:51 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605209/ [5605210] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605210/ [5605211] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605211/ [5605212] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_5925} time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605212/ [5605213] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:30:03 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605213/ [5605214] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/workunits} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605214/ [5605215] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605215/ [5605216] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:22:13 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605216/ [5605217] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:15:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605217/ [5605218] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605218/ [5605219] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605219/ [5605220] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605220/ [5605221] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605221/ [5605222] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605222/ [5605223] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605223/ [5605224] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/valgrind} time: 00:25:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605224/ [5605225] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:16 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605225/ [5605226] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605226/ [5605227] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605227/ [5605228] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605228/ [5605230] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:31 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605230/ [5605231] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605231/ [5605232] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605232/ [5605233] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605233/ [5605234] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605234/ [5605235] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605235/ [5605236] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605236/ [5605237] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:14:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605237/ [5605238] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:08:56 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605238/ [5605239] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mgr} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605239/ [5605240] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:16 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605240/ [5605241] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:05:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605241/ [5605242] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605242/ [5605243] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605243/ [5605245] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:31:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605245/ [5605246] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} time: 00:32:46 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605246/ [5605247] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:04:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605247/ [5605248] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605248/ [5605249] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605249/ [5605250] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:56 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605250/ [5605251] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605251/ [5605252] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605252/ [5605254] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:06:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605254/ [5605255] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:36:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605255/ [5605256] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:36:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605256/ [5605257] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605257/ [5605258] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:10 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605258/ [5605259] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605259/ [5605260] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605260/ [5605261] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605261/ [5605262] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:15:40 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605262/ [5605263] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605263/ [5605264] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605264/ [5605265] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605265/ [5605266] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605266/ [5605267] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605267/ [5605268] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/misc} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605268/ [5605269] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605269/ [5605270] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:07:02 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605270/ [5605271] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605271/ [5605272] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605272/ [5605273] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605273/ [5605274] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605274/ [5605275] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605275/ [5605276] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605276/ [5605277] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605277/ [5605278] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605278/ [5605279] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605279/ [5605280] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605280/ [5605281] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:22:19 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605281/ [5605282] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605282/ [5605283] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605283/ [5605284] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:29:43 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605284/ [5605285] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605285/ [5605286] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:38:51 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605286/ [5605287] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:15 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605287/ [5605288] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:25:02 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605288/ [5605289] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605289/ [5605290] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:44 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605290/ [5605291] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605291/ [5605292] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605292/ [5605293] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:39:51 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605293/ [5605294] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605294/ [5605295] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} time: 02:18:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605295/ [5605297] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605297/ [5605298] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605298/ [5605299] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605299/ [5605300] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605300/ [5605301] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:53 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605301/ [5605302] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:52:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605302/ [5605303] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605303/ [5605304] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605304/ [5605305] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605305/ [5605306] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605306/ [5605307] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605307/ [5605308] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605308/ [5605309] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:35:46 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605309/ [5605310] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:40:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605310/ [5605311] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605311/ [5605312] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:58 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605312/ [5605313] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605313/ [5605314] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:04:39 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605314/ [5605315] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605315/ [5605316] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:35:13 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605316/ [5605317] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605317/ [5605318] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605318/ [5605319] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605319/ [5605320] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd} time: 03:11:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605320/ [5605321] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:58:42 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605321/ [5605323] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605323/ [5605324] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605324/ [5605325] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605325/ [5605326] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605326/ [5605327] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605327/ [5605328] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:59:40 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605328/ [5605329] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:23 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605329/ [5605330] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605330/ [5605331] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605331/ [5605332] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 05:16:07 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605332/ [5605333] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:14 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605333/ [5605334] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605334/ [5605335] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:25:22 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605335/ [5605336] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605336/ [5605337] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605337/ [5605338] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605338/ [5605339] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605339/ [5605340] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:28:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605340/ [5605341] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:22:57 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605341/ [5605342] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:05:26 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605342/ [5605343] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605343/ [5605344] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/scrub} time: 01:36:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605344/ [5605345] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:36:35 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605345/ [5605346] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605346/ [5605347] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:26:50 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605347/ [5605348] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605348/ [5605349] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 00:58:49 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605349/ [5605350] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605350/ [5605351] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605351/ [5605352] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605352/ [5605353] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:32:41 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605353/ [5605354] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:29:09 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605354/ [5605355] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605355/ [5605357] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605357/