2021-01-23T07:07:12.602 INFO:root:teuthology version: 1.0.0-fe79ba1b 2021-01-23T07:07:12.603 INFO:teuthology.results:subset: '27/100000' 2021-01-23T07:07:12.604 INFO:teuthology.results:seed: '7975' 2021-01-24T03:50:54.476 INFO:root:teuthology version: 1.0.0-fe79ba1b 2021-01-24T03:50:56.305 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-24T12:10:13.932 INFO:teuthology.results:Tests finished! gathering results... 2021-01-24T12:11:00.111 INFO:scrape:Found 367 jobs 2021-01-24T12:11:09.935 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:09.937 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:09.937 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:09.938 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.053 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.055 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.055 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.056 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.198 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.200 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.201 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.201 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.317 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.319 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.320 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.320 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.440 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.442 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.443 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.443 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.559 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.561 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.562 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.562 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.679 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.681 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.682 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.682 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.804 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.806 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.806 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.807 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:10.921 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:10.923 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:10.924 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:10.925 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:11.042 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:11.043 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:11.044 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:11.045 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:11.161 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:11.163 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:11.163 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:11.164 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:11.275 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:11.277 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:11.278 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:11.278 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:11.393 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:11.395 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:11.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:11.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:11.509 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:11.510 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:11.511 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:11.512 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:11.624 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fabe22d0a1a] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x275c34) [0x7fabe22d0c34] 2021-01-24T12:11:11.625 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-23T11:41:13.144 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-23T11:41:13.366 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-01-24T12:11:11.626 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:42:14.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba015.front.sepia.ceph.com , 2021-01-23T11:42:14.849 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2021-01-23T11:42:17.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba015.front.sepia.ceph.com 2021-01-24T12:11:11.627 WARNING:scrape:Ignoring malparsed backtrace: 2021-01-23T11:43:55.907 DEBUG:teuthology.orchestra.run.gibba003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' , 2021-01-23T11:43:55.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2021-01-23T11:43:55.929 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-24T12:11:19.443 INFO:scrape:Found 16 distinct failure reasons 2021-01-24T12:11:19.444 INFO:scrape:Failure: Command failed on gibba018 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'egrep \'"\'"\'(defer backfill|defer recovery)\'"\'"\' /var/log/ceph/ceph-osd.*.log\'' 2021-01-24T12:11:19.445 INFO:scrape:2 jobs: ['5819744', '5819503'] 2021-01-24T12:11:19.445 INFO:scrape:suites intersection: ['msgr-failures/few', 'rados'] 2021-01-24T12:11:19.446 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/singleton/{all/recovery-preemption', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2021-01-24T12:11:19.447 INFO:scrape: 2021-01-24T12:11:19.447 INFO:scrape:Failure: Could not find an image for rhel 8.0 2021-01-24T12:11:19.448 INFO:scrape:8 jobs: ['5819718', '5819539', '5819654', '5819478', '5819505', '5819636', '5819662', '5819444'] 2021-01-24T12:11:19.448 INFO:scrape: 2021-01-24T12:11:19.448 INFO:scrape:Failure: Command failed on gibba037 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 2bf357e4-5d78-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.137 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2021-01-24T12:11:19.449 INFO:scrape:8 jobs: ['5819483', '5819436', '5819664', '5819669', '5819738', '5819573', '5819516', '5819549'] 2021-01-24T12:11:19.449 INFO:scrape:suites intersection: [] 2021-01-24T12:11:19.450 INFO:scrape:suites union: ['fixed-2', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async-v2only', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'start', 'start}', 'task/test_orch_cli}', 'tasks/rados_api_tests}'] 2021-01-24T12:11:19.450 INFO:scrape: 2021-01-24T12:11:19.451 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on gibba030 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b735d2e13bb8966f1b3355910bd2860b4d99810 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-24T12:11:19.451 INFO:scrape:3 jobs: ['5819589', '5819722', '5819455'] 2021-01-24T12:11:19.452 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2021-01-24T12:11:19.452 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-24T12:11:19.452 INFO:scrape: 2021-01-24T12:11:19.453 INFO:scrape:Failure: Command failed on gibba015 with status 1: "sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid ed7e52ae-5da7-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.2.115:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" 2021-01-24T12:11:19.453 INFO:scrape:1 jobs: ['5819579'] 2021-01-24T12:11:19.454 INFO:scrape:suites: ['fixed-2', 'mode/packaged', 'mon_election/connectivity', 'msgr/async-v1only', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'start', 'tasks/rados_api_tests}'] 2021-01-24T12:11:19.454 INFO:scrape: 2021-01-24T12:11:19.455 INFO:scrape:Failure: Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) 2021-01-24T12:11:19.455 INFO:scrape:4 jobs: ['5819404', '5819569', '5819550', '5819651'] 2021-01-24T12:11:19.455 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}'] 2021-01-24T12:11:19.456 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2021-01-24T12:11:19.456 INFO:scrape: 2021-01-24T12:11:19.457 INFO:scrape:Failure: Command failed on gibba006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 29244b36-5d50-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.106 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2021-01-24T12:11:19.457 INFO:scrape:2 jobs: ['5819391', '5819729'] 2021-01-24T12:11:19.458 INFO:scrape:suites intersection: ['fixed-2', 'mon_election/classic'] 2021-01-24T12:11:19.458 INFO:scrape:suites union: ['fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr/async', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'start', 'start}', 'tasks/rados_python}'] 2021-01-24T12:11:19.459 INFO:scrape: 2021-01-24T12:11:19.459 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on gibba009 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b735d2e13bb8966f1b3355910bd2860b4d99810 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-01-24T12:11:19.460 INFO:scrape:1 jobs: ['5819427'] 2021-01-24T12:11:19.460 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/lockdep}'] 2021-01-24T12:11:19.461 INFO:scrape: 2021-01-24T12:11:19.461 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2021-01-24T12:11:19.461 INFO:scrape:1 jobs: ['5819560'] 2021-01-24T12:11:19.462 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/lost-unfound', 'supported-random-distro$/{ubuntu_latest}}'] 2021-01-24T12:11:19.462 INFO:scrape: 2021-01-24T12:11:19.463 INFO:scrape:Failure: Found coredumps on ubuntu@gibba018.front.sepia.ceph.com 2021-01-24T12:11:19.463 INFO:scrape:1 jobs: ['5819691'] 2021-01-24T12:11:19.463 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-01-24T12:11:19.464 INFO:scrape: 2021-01-24T12:11:19.464 INFO:scrape:Failure: SSH connection to gibba018 was lost: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 150 write'" 2021-01-24T12:11:19.465 INFO:scrape:1 jobs: ['5819534'] 2021-01-24T12:11:19.465 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/fastread', 'thrashosds-health', 'workloads/ec-radosbench}'] 2021-01-24T12:11:19.466 INFO:scrape: 2021-01-24T12:11:19.466 INFO:scrape:Dead: b'2021-01-24T01:40:30.305 DEBUG:teuthology.exit:Finished running handlers' 2021-01-24T12:11:19.467 INFO:scrape:2 jobs: ['5819506', '5819678'] 2021-01-24T12:11:19.467 INFO:scrape:suites intersection: ['mon_election/connectivity', 'rados'] 2021-01-24T12:11:19.468 INFO:scrape:suites union: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-small-objects}'] 2021-01-24T12:11:19.468 INFO:scrape: 2021-01-24T12:11:19.469 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-24T12:11:19.469 INFO:scrape:3 jobs: ['5819740', '5819680', '5819700'] 2021-01-24T12:11:19.470 INFO:scrape:suites intersection: [] 2021-01-24T12:11:19.470 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'distro$/{centos_8.0}', 'fixed-2', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity}', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/cephadm/upgrade/{1-start', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-24T12:11:19.470 INFO:scrape: 2021-01-24T12:11:19.471 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2021-01-24T12:11:19.471 INFO:scrape:1 jobs: ['5819462'] 2021-01-24T12:11:19.472 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}'] 2021-01-24T12:11:19.472 INFO:scrape: 2021-01-24T12:11:19.472 INFO:scrape:Failure: "2021-01-24T02:07:19.928892+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 34 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log 2021-01-24T12:11:19.473 INFO:scrape:1 jobs: ['5819705'] 2021-01-24T12:11:19.473 INFO:scrape:suites: ['mon_election/connectivity', 'objectstore/bluestore-low-osd-mem-target', 'openstack', 'rados/perf/{ceph', 'scheduler/dmclock_default_shards', 'settings/optimized', 'ubuntu_latest', 'workloads/radosbench_omap_write}'] 2021-01-24T12:11:19.474 INFO:scrape: 2021-01-24T12:11:19.474 INFO:scrape:Crash: Test failure: test_pool_removal (tasks.mgr.test_progress.TestProgress) 2021-01-24T12:11:19.474 INFO:scrape:ceph version 17.0.0-9-g9b735d2e (9b735d2e13bb8966f1b3355910bd2860b4d99810) pacific (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7fd062dc8980] 2: gsignal() 3: abort() 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1a7) [0x56374d8d138f] 5: (KernelDevice::_aio_thread()+0xbb9) [0x56374e3b17a9] 6: (KernelDevice::AioCompletionThread::entry()+0xd) [0x56374e3b3a6d] 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7fd062dbd6db] 8: clone() 2021-01-24T12:11:19.475 INFO:scrape:1 jobs: ['5819422'] 2021-01-24T12:11:19.475 INFO:scrape:suites: ['debug/mgr', 'mon_election/classic', 'objectstore/bluestore-hybrid', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/progress}'] 2021-01-24T12:11:19.476 INFO:scrape: 2021-01-24T12:11:19.491 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/ failed: 30 dead: 10 running: 0 waiting: 0 queued: 0 passed: 327 Fail ================================================================= [5819391] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819391/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819391/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd2463fa3c424891a994440e43a59210 Command failed on gibba006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 29244b36-5d50-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.106 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819404] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 01:04:27 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819404/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819404/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5cb4218570b4026a6367f7ba3e04ace Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) [5819422] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/progress} ----------------------------------------------------------------- time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819422/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819422/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a696e130440e473facc952b54038cde3 Test failure: test_pool_removal (tasks.mgr.test_progress.TestProgress) [5819427] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:33:16 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819427/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819427/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d5537ae3ad840efa99341e004aaddde Command failed (workunit test rados/test.sh) on gibba009 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b735d2e13bb8966f1b3355910bd2860b4d99810 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5819436] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819436/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819436/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7546d18aa1514ab184089fc5c4d62cef Command failed on gibba015 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 6958f5fa-5d62-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.115 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819455] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819455/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819455/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e971105ea6b1444fa7f9564ee42f1c09 Command failed (workunit test cephadm/test_cephadm.sh) on gibba032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b735d2e13bb8966f1b3355910bd2860b4d99810 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5819462] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819462/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819462/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5819483] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819483/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819483/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0fdc2d5befd4987be490451743ba274 Command failed on gibba037 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 2bf357e4-5d78-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.137 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819503] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 11:39:38 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819503/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819503/ Command failed on gibba039 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [5819516] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819516/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ce04f0f233b49dd8778b12bdf01d6b0 Command failed on gibba018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid d288ccae-5d84-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.118 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819534] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 01:35:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819534/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819534/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2a00d71a44647898d60e0f52a688be1 SSH connection to gibba018 was lost: "/bin/sh -c 'adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 150 write'" [5819549] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819549/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819549/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b95f7cb47af2493ab8a7aac7a6406d39 Command failed on gibba032 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid df6c6244-5d95-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.2.132 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819550] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 01:01:58 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819550/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819550/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90074090e80548edbfb950284e80dc23 Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) [5819560] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 01:03:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819560/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819560/ Scrubbing terminated -- not all pgs were active and clean. [5819569] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 01:00:25 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819569/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819569/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fee09301e0b448ce9a8df51af075417d Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) [5819573] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:17 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819573/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819573/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08da118f75dc44e7baa3c3246e49bc77 Command failed on gibba015 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 6128dfa6-5da5-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.115 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819579] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819579/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819579/ sentry: https://sentry.ceph.com/organizations/ceph/?query=113298748e364cbcbb5735fddfdaf85c Command failed on gibba015 with status 1: "sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid ed7e52ae-5da7-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.2.115:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5819589] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819589/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819589/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5cf6b9a87d542f8833f1830c21d42e5 Command failed (workunit test cephadm/test_cephadm.sh) on gibba030 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b735d2e13bb8966f1b3355910bd2860b4d99810 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5819651] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 01:05:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819651/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ecd7530a042408293a426be89514e17 Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) [5819664] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819664/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819664/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa05ef6079bc483dabaa756eee427f6a Command failed on gibba037 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 9db01246-5dd2-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.137 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819669] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819669/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819669/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18e4622697e44b38bfd28f05ab9cf262 Command failed on gibba037 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 9f04c7c0-5dd4-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.137 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819680] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:55:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819680/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819680/ reached maximum tries (50) after waiting for 300 seconds [5819691] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819691/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819691/ Found coredumps on ubuntu@gibba018.front.sepia.ceph.com [5819700] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819700/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819700/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4071939d255e456d9b273a2e85ab726b reached maximum tries (180) after waiting for 180 seconds [5819705] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} ----------------------------------------------------------------- time: 00:42:02 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819705/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819705/ "2021-01-24T02:07:19.928892+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 34 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log [5819722] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819722/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819722/ sentry: https://sentry.ceph.com/organizations/ceph/?query=594bae5205344ea688d4e11151ca93ca Command failed (workunit test cephadm/test_cephadm.sh) on gibba040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b735d2e13bb8966f1b3355910bd2860b4d99810 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5819729] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819729/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819729/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe570bb2988a4d1baf647836986350a5 Command failed on gibba027 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid 4864c23c-5df0-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.2.127 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819738] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819738/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819738/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cfa3b0467994e8a98566946ecdcabb9 Command failed on gibba021 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9b735d2e13bb8966f1b3355910bd2860b4d99810 -v bootstrap --fsid f95857c2-5df3-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.2.121 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5819740] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819740/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819740/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9435f897ec014b71abf3d74eca0c94bf reached maximum tries (180) after waiting for 180 seconds [5819744] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819744/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819744/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03f02409f98f444ebd234def7e4e2ed0 Command failed on gibba018 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'egrep \'"\'"\'(defer backfill|defer recovery)\'"\'"\' /var/log/ceph/ceph-osd.*.log\'' Dead ================================================================= [5819444] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819444/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=044babe14f6248dfbef24280d431984f Could not find an image for rhel 8.0 [5819478] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819478/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819478/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31ac89a1756a49ce82585dfbd49de97c Could not find an image for rhel 8.0 [5819505] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819505/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7425a020e9d942a088217bcb9eef68ef Could not find an image for rhel 8.0 [5819506] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819506/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819506/ [5819539] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819539/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819539/ sentry: https://sentry.ceph.com/organizations/ceph/?query=171db2c4f2cb445a823452d494d71958 Could not find an image for rhel 8.0 [5819636] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819636/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819636/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1889af5eed24d38b399370460fae152 Could not find an image for rhel 8.0 [5819654] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819654/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819654/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e5d17fc863341d6aebef84a99774858 Could not find an image for rhel 8.0 [5819662] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819662/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819662/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6fd8ef5eea7c4fd4bd2a62c3f9ddc1ff Could not find an image for rhel 8.0 [5819678] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819678/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819678/ [5819718] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819718/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819718/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fd4f02d1f784a3e8baa7ae7a7599018 Could not find an image for rhel 8.0 Pass ================================================================= [5819381] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:36:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819381/ [5819382] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:03:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819382/ [5819383] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819383/ [5819384] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:34:24 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819384/ [5819385] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819385/ [5819386] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:22:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819386/ [5819387] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:27:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819387/ [5819388] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819388/ [5819389] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819389/ [5819390] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:22:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819390/ [5819392] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819392/ [5819393] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819393/ [5819394] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819394/ [5819395] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:21 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819395/ [5819396] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:33:13 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819396/ [5819397] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:43:37 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819397/ [5819398] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:08:27 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819398/ [5819399] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819399/ [5819400] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819400/ [5819401] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819401/ [5819402] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819402/ [5819403] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:48:53 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819403/ [5819405] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:20:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819405/ [5819406] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:20:26 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819406/ [5819407] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819407/ [5819408] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819408/ [5819409] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:12:54 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819409/ [5819410] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819410/ [5819411] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:48 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819411/ [5819412] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819412/ [5819413] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819413/ [5819414] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:35:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819414/ [5819415] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:22:31 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819415/ [5819416] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819416/ [5819417] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819417/ [5819418] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819418/ [5819419] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819419/ [5819420] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:08 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819420/ [5819421] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:22:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819421/ [5819423] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:02 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819423/ [5819424] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819424/ [5819425] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819425/ [5819426] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819426/ [5819428] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:28 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819428/ [5819429] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:54 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819429/ [5819430] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819430/ [5819431] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819431/ [5819432] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819432/ [5819433] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819433/ [5819434] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819434/ [5819435] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 01:29:19 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819435/ [5819437] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:46:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819437/ [5819438] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:29:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819438/ [5819439] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} time: 00:41:34 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819439/ [5819440] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819440/ [5819441] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819441/ [5819442] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819442/ [5819443] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:41:23 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819443/ [5819445] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819445/ [5819446] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:06:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819446/ [5819447] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819447/ [5819448] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819448/ [5819449] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819449/ [5819450] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 00:55:36 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819450/ [5819451] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:29:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819451/ [5819452] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819452/ [5819453] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819453/ [5819454] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:29:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819454/ [5819456] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/prometheus} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819456/ [5819457] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:45:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819457/ [5819458] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mgr} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819458/ [5819459] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819459/ [5819460] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819460/ [5819461] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:17 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819461/ [5819463] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:26:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819463/ [5819464] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819464/ [5819465] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819465/ [5819466] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 01:48:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819466/ [5819467] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:30 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819467/ [5819468] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819468/ [5819469] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:17 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819469/ [5819470] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819470/ [5819471] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819471/ [5819472] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819472/ [5819473] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819473/ [5819474] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819474/ [5819475] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:58:23 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819475/ [5819476] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819476/ [5819477] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819477/ [5819479] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819479/ [5819480] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819480/ [5819481] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819481/ [5819482] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819482/ [5819484] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:35:27 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819484/ [5819485] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819485/ [5819486] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819486/ [5819487] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819487/ [5819488] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819488/ [5819489] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819489/ [5819490] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:17:48 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819490/ [5819491] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:34:15 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819491/ [5819492] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819492/ [5819493] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819493/ [5819494] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:06 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819494/ [5819495] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819495/ [5819496] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819496/ [5819497] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819497/ [5819498] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:46:52 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819498/ [5819499] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819499/ [5819500] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819500/ [5819501] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819501/ [5819502] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819502/ [5819504] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819504/ [5819507] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819507/ [5819508] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819508/ [5819509] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:02:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819509/ [5819510] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} time: 00:33:59 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819510/ [5819511] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819511/ [5819512] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} time: 00:46:16 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819512/ [5819513] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819513/ [5819514] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819514/ [5819515] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:44 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819515/ [5819517] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:22:03 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819517/ [5819518] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819518/ [5819519] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819519/ [5819520] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819520/ [5819521] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819521/ [5819522] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819522/ [5819523] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819523/ [5819524] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819524/ [5819525] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819525/ [5819526] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/crash} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819526/ [5819527] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:13 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819527/ [5819528] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:24:25 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819528/ [5819529] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819529/ [5819530] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:40:28 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819530/ [5819531] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819531/ [5819532] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 01:08:53 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819532/ [5819533] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819533/ [5819535] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:31:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819535/ [5819536] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819536/ [5819537] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:50:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819537/ [5819538] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819538/ [5819540] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/osd} time: 03:16:52 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819540/ [5819541] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:48 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819541/ [5819542] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:38:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819542/ [5819543] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819543/ [5819544] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819544/ [5819545] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819545/ [5819546] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819546/ [5819547] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:27:57 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819547/ [5819548] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819548/ [5819551] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819551/ [5819552] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:30:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819552/ [5819553] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819553/ [5819554] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:04:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819554/ [5819555] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819555/ [5819556] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819556/ [5819557] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819557/ [5819558] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819558/ [5819559] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/failover} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819559/ [5819561] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819561/ [5819562] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/scrub} time: 01:46:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819562/ [5819563] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:40:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819563/ [5819564] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819564/ [5819565] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819565/ [5819566] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:36:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819566/ [5819567] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819567/ [5819568] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819568/ [5819570] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:06:45 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819570/ [5819571] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819571/ [5819572] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:24:32 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819572/ [5819574] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:04:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819574/ [5819575] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819575/ [5819576] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819576/ [5819577] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:46:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819577/ [5819578] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:13 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819578/ [5819580] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819580/ [5819581] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:34:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819581/ [5819582] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:02 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819582/ [5819583] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/many workloads/pool-create-delete} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819583/ [5819584] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819584/ [5819585] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819585/ [5819586] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 01:47:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819586/ [5819587] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:48:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819587/ [5819588] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819588/ [5819590] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819590/ [5819591] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819591/ [5819592] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/crush} time: 00:20:21 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819592/ [5819593] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819593/ [5819594] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:28:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819594/ [5819595] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:35:57 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819595/ [5819596] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819596/ [5819597] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819597/ [5819598] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/insights} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819598/ [5819599] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819599/ [5819600] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819600/ [5819601] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819601/ [5819602] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819602/ [5819603] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819603/ [5819604] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819604/ [5819605] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:33 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819605/ [5819606] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819606/ [5819607] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 01:52:08 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819607/ [5819608] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819608/ [5819609] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819609/ [5819610] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:03 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819610/ [5819611] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:16:38 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819611/ [5819612] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819612/ [5819613] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:30:12 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819613/ [5819614] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819614/ [5819615] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819615/ [5819616] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:41:39 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819616/ [5819617] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819617/ [5819618] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819618/ [5819619] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:47:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819619/ [5819620] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819620/ [5819621] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819621/ [5819622] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819622/ [5819623] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819623/ [5819624] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819624/ [5819625] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819625/ [5819626] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819626/ [5819627] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819627/ [5819628] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819628/ [5819629] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:03:29 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819629/ [5819630] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:28:15 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819630/ [5819631] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819631/ [5819632] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:26:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819632/ [5819633] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819633/ [5819634] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819634/ [5819635] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819635/ [5819637] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819637/ [5819638] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:23:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819638/ [5819639] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819639/ [5819640] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819640/ [5819641] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819641/ [5819642] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819642/ [5819643] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819643/ [5819644] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819644/ [5819645] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:16:57 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819645/ [5819646] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819646/ [5819647] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:52:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819647/ [5819648] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:35:06 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819648/ [5819649] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819649/ [5819650] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819650/ [5819652] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819652/ [5819653] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819653/ [5819655] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:42:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819655/ [5819656] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819656/ [5819657] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:21:29 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819657/ [5819658] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:34:19 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819658/ [5819659] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819659/ [5819660] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819660/ [5819661] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819661/ [5819663] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819663/ [5819665] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819665/ [5819666] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:20:37 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819666/ [5819667] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819667/ [5819668] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc} time: 00:36:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819668/ [5819670] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:10 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819670/ [5819671] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:24:58 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819671/ [5819672] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:18:32 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819672/ [5819673] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:05:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819673/ [5819674] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819674/ [5819675] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819675/ [5819676] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:20 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819676/ [5819677] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819677/ [5819679] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819679/ [5819681] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819681/ [5819682] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819682/ [5819683] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:48:24 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819683/ [5819684] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:20:53 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819684/ [5819685] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819685/ [5819686] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819686/ [5819687] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819687/ [5819688] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819688/ [5819689] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819689/ [5819690] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819690/ [5819692] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819692/ [5819693] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:58:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819693/ [5819694] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819694/ [5819695] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819695/ [5819696] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mon} time: 00:45:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819696/ [5819697] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819697/ [5819698] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819698/ [5819699] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819699/ [5819701] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819701/ [5819702] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819702/ [5819703] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:40:57 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819703/ [5819704] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819704/ [5819706] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:05:30 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819706/ [5819707] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819707/ [5819708] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819708/ [5819709] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819709/ [5819710] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819710/ [5819711] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819711/ [5819712] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819712/ [5819713] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:30 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819713/ [5819714] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819714/ [5819715] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819715/ [5819716] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:29:56 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819716/ [5819717] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819717/ [5819719] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:04 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819719/ [5819720] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819720/ [5819721] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:18:55 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819721/ [5819723] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:43:57 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819723/ [5819724] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:29:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819724/ [5819725] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:32 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819725/ [5819726] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819726/ [5819727] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819727/ [5819728] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:36:59 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819728/ [5819730] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:34 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819730/ [5819731] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:03:19 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819731/ [5819732] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:53:57 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819732/ [5819733] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819733/ [5819734] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819734/ [5819735] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:44:30 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819735/ [5819736] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819736/ [5819737] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819737/ [5819739] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819739/ [5819741] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819741/ [5819742] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819742/ [5819743] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819743/ [5819745] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/scrub} time: 01:51:05 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819745/ [5819746] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:14:09 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819746/ [5819747] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2021-01-23_07:01:02-rados-master-distro-basic-gibba/5819747/