2020-09-19T06:41:03.623 INFO:root:teuthology version: 1.0.0-f390fd3 2020-09-19T06:41:03.624 INFO:teuthology.results:subset: '4/100000' 2020-09-19T06:41:03.624 INFO:teuthology.results:seed: '1248' 2020-09-19T11:55:57.414 INFO:root:teuthology version: 1.0.0-f390fd3 2020-09-19T11:55:57.461 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-09-19T17:09:07.447 INFO:teuthology.results:Tests finished! gathering results... 2020-09-19T17:09:41.214 INFO:scrape:Found 307 jobs 2020-09-19T17:09:42.577 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-5311-g0f2e67a (0f2e67a616a62d05cee25404988d4426adc274d6) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fc01d9d0010] , 2: (AdminSocketOutput::run_command(AdminSocketClient&, std::__cxx11::basic_string, std::allocator > const&, bool)+0x353) [0x56398125f4a3] 2020-09-19T17:09:42.634 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.635 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.649 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.637 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.679 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-09-19T07:04:16.224900+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.639 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.072 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.639 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.115 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.643 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.643 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.693 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.556 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.720 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.001 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.720 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.723 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.051 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.723 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.725 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.457 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.726 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.825 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.727 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.852 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.729 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.879 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-09-19T07:07:08.880 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-09-19T17:09:42.729 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.260 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.732 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.732 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.732 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.735 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.831 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:50.136 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.832 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.519 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.834 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.547 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.836 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.836 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.297 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.838 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.841 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.151 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.866 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.868 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.876 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.632 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.877 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:11:55.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com , 2020-09-19T07:11:55.972 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2020-09-19T07:11:56.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2020-09-19T17:09:42.886 WARNING:scrape:Not-understood crash indication Binary file /home/teuthworker/archive/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420149/teuthology.log matches 2020-09-19T17:09:42.887 WARNING:scrape:Not-understood crash indication 2020-09-19T17:09:42.897 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-5311-g0f2e67a (0f2e67a616a62d05cee25404988d4426adc274d6) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fc01d9d0010] , 2: (AdminSocketOutput::run_command(AdminSocketClient&, std::__cxx11::basic_string, std::allocator > const&, bool)+0x353) [0x56398125f4a3] 2020-09-19T17:09:42.898 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.899 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.649 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.679 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-09-19T07:04:16.224900+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.072 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.902 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.115 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.904 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.904 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.906 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.556 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.907 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.001 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.908 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.910 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.051 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.910 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.912 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.457 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.913 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.825 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.914 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.852 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.916 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.879 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-09-19T07:07:08.880 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-09-19T17:09:42.916 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.260 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.918 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.919 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.732 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.921 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.924 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:50.136 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.925 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.519 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.927 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.547 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.930 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.931 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.297 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.933 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.935 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.151 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.939 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.942 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.950 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.632 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.951 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:11:55.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com , 2020-09-19T07:11:55.972 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2020-09-19T07:11:56.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2020-09-19T17:09:42.958 WARNING:scrape:Not-understood crash indication Binary file /home/teuthworker/archive/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420149/teuthology.log matches 2020-09-19T17:09:42.959 WARNING:scrape:Not-understood crash indication 2020-09-19T17:09:42.969 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-5311-g0f2e67a (0f2e67a616a62d05cee25404988d4426adc274d6) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fc01d9d0010] , 2: (AdminSocketOutput::run_command(AdminSocketClient&, std::__cxx11::basic_string, std::allocator > const&, bool)+0x353) [0x56398125f4a3] 2020-09-19T17:09:42.970 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.970 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.649 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.972 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.679 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-09-19T07:04:16.224900+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.973 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.072 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.974 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.115 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.976 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.977 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.979 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.556 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.979 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.001 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.980 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.982 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.051 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.983 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.985 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.457 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.986 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.825 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.986 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.852 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.988 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.879 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-09-19T07:07:08.880 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-09-19T17:09:42.989 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.260 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.991 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.992 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.732 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.994 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.996 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:50.136 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.997 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.519 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:42.999 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.547 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.001 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.002 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.297 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.004 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.006 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.151 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.010 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.012 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.019 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.632 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.020 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:11:55.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com , 2020-09-19T07:11:55.972 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2020-09-19T07:11:56.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2020-09-19T17:09:43.029 WARNING:scrape:Not-understood crash indication Binary file /home/teuthworker/archive/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420149/teuthology.log matches 2020-09-19T17:09:43.030 WARNING:scrape:Not-understood crash indication 2020-09-19T17:09:43.046 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.0.0-5311-g0f2e67a (0f2e67a616a62d05cee25404988d4426adc274d6) pacific (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fc01d9d0010] , 2: (AdminSocketOutput::run_command(AdminSocketClient&, std::__cxx11::basic_string, std::allocator > const&, bool)+0x353) [0x56398125f4a3] 2020-09-19T17:09:43.047 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.621 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.048 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.648 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.649 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:06.679 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-09-19T07:04:16.224900+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:06.680 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.072 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.073 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.054 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.114 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.115 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.057 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:27.139 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.522 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.060 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:05:47.556 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-09-19T07:04:20.234649+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=20, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:05:47.557 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.001 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.002 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.026 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.063 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.050 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:08.051 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.064 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.427 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.066 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.456 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:28.457 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.067 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.825 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.826 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.067 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.852 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.853 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.069 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:06:48.879 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:06:48.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-09-19T07:07:08.880 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-09-19T17:09:43.070 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.259 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.260 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.072 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:09.288 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.073 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.731 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.732 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.075 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2020-09-19T07:04:40.349924+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=40, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:29.765 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2020-09-19T07:04:38.344406+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=38, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.077 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:07:50.136 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:07:50.137 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.078 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.518 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.519 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.080 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.546 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:10.547 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.081 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:30.918 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.082 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.297 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.298 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.084 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:08:51.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:08:51.324 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2020-09-19T07:04:42.356168+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=42, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.086 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.150 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:12.151 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.089 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2020-09-19T07:04:44.361703+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=44, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:09:32.528 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.091 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2020-09-19T07:04:46.368447+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=46, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:13.247 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.098 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.631 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) , 2020-09-19T07:10:33.632 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2020-09-19T07:04:48.374019+0000 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=4, tm_sec=48, tm_wday=5, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=19, tm_hour=7, tm_min=5, tm_sec=4, tm_wday=5, tm_yday=263, tm_isdst=0) 2020-09-19T17:09:43.099 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-19T07:11:55.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com , 2020-09-19T07:11:55.972 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 , 2020-09-19T07:11:56.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2020-09-19T17:09:43.107 WARNING:scrape:Not-understood crash indication Binary file /home/teuthworker/archive/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420149/teuthology.log matches 2020-09-19T17:09:43.108 WARNING:scrape:Not-understood crash indication 2020-09-19T17:09:43.575 INFO:scrape:Found 5 distinct failure reasons 2020-09-19T17:09:43.664 INFO:scrape:Failure: 'available_might_have_unfound' 2020-09-19T17:09:43.665 INFO:scrape:1 jobs: ['5420171'] 2020-09-19T17:09:43.665 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton/{all/lost-unfound', 'supported-random-distro$/{rhel_8}}'] 2020-09-19T17:09:43.666 INFO:scrape: 2020-09-19T17:09:43.666 INFO:scrape:Failure: Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_admin_socket_output --all'" 2020-09-19T17:09:43.666 INFO:scrape:1 jobs: ['5420149'] 2020-09-19T17:09:43.667 INFO:scrape:suites: ['rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{centos_8}}'] 2020-09-19T17:09:43.667 INFO:scrape: 2020-09-19T17:09:43.667 INFO:scrape:Failure: Command failed (workunit test mon/mon-handle-forward.sh) on smithi109 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1f8589679b6e3614e4d921055a545c182e8abf7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh' 2020-09-19T17:09:43.667 INFO:scrape:1 jobs: ['5420322'] 2020-09-19T17:09:43.668 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/mon}'] 2020-09-19T17:09:43.668 INFO:scrape: 2020-09-19T17:09:43.668 INFO:scrape:Failure: Command failed (workunit test mon/crush_ops.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1f8589679b6e3614e4d921055a545c182e8abf7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' 2020-09-19T17:09:43.669 INFO:scrape:1 jobs: ['5420208'] 2020-09-19T17:09:43.669 INFO:scrape:suites: ['clusters/3-mons', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/one', 'workloads/rados_mon_workunits}'] 2020-09-19T17:09:43.669 INFO:scrape: 2020-09-19T17:09:43.670 INFO:scrape:Failure: wait_for_clean: failed before timeout expired 2020-09-19T17:09:43.670 INFO:scrape:1 jobs: ['5420151'] 2020-09-19T17:09:43.670 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2020-09-19T17:09:43.671 INFO:scrape: 2020-09-19T17:09:43.684 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 302 Fail ================================================================= [5420149] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420149/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420149/ sentry: https://sentry.ceph.com/sentry/sepia/?query=3fb25fd490bd41bdaa116e94885254fb Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_admin_socket_output --all'" [5420151] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 00:56:42 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420151/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420151/ sentry: https://sentry.ceph.com/sentry/sepia/?query=6b2f3f4f0ae54dfc8839726b8f979929 wait_for_clean: failed before timeout expired [5420171] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:46:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420171/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420171/ sentry: https://sentry.ceph.com/sentry/sepia/?query=5cb64622e5d045aeaba6ffb25c648419 'available_might_have_unfound' [5420208] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420208/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420208/ sentry: https://sentry.ceph.com/sentry/sepia/?query=2d332fa0167647a99f8441557d673461 Command failed (workunit test mon/crush_ops.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1f8589679b6e3614e4d921055a545c182e8abf7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh' [5420322] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420322/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420322/ sentry: https://sentry.ceph.com/sentry/sepia/?query=d4f4adcd9aba4f0f89d3a088f69f51f7 Command failed (workunit test mon/mon-handle-forward.sh) on smithi109 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1f8589679b6e3614e4d921055a545c182e8abf7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle- forward.sh' Pass ================================================================= [5420135] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:37:36 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420135/ [5420136] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420136/ [5420137] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420137/ [5420138] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:29:37 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420138/ [5420139] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420139/ [5420140] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:33:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420140/ [5420141] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:44:10 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420141/ [5420142] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420142/ [5420143] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/crash} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420143/ [5420144] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:02:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420144/ [5420145] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420145/ [5420146] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420146/ [5420147] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420147/ [5420148] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:29:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420148/ [5420150] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420150/ [5420152] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420152/ [5420153] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420153/ [5420154] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420154/ [5420155] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420155/ [5420156] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420156/ [5420157] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:16 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420157/ [5420158] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420158/ [5420159] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:34:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420159/ [5420160] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:06 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420160/ [5420161] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420161/ [5420162] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420162/ [5420163] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420163/ [5420164] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 00:47:10 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420164/ [5420165] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2} time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420165/ [5420166] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:21:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420166/ [5420167] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420167/ [5420168] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:26:13 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420168/ [5420169] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420169/ [5420170] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420170/ [5420172] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420172/ [5420173] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420173/ [5420174] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:00 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420174/ [5420175] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420175/ [5420176] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:10:29 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420176/ [5420177] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420177/ [5420178] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420178/ [5420179] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420179/ [5420180] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420180/ [5420181] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420181/ [5420182] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420182/ [5420183] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420183/ [5420184] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}} time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420184/ [5420185] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420185/ [5420186] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420186/ [5420187] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420187/ [5420188] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420188/ [5420189] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:34:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420189/ [5420190] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:32:59 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420190/ [5420191] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420191/ [5420192] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420192/ [5420193] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420193/ [5420194] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420194/ [5420195] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420195/ [5420196] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420196/ [5420197] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420197/ [5420198] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420198/ [5420199] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420199/ [5420200] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420200/ [5420201] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420201/ [5420202] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420202/ [5420203] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420203/ [5420204] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:38:13 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420204/ [5420205] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420205/ [5420206] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/insights} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420206/ [5420207] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420207/ [5420209] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420209/ [5420210] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420210/ [5420211] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:30:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420211/ [5420212] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420212/ [5420213] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420213/ [5420214] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420214/ [5420215] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:05:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420215/ [5420216] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:32:50 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420216/ [5420217] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420217/ [5420218] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420218/ [5420219] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420219/ [5420220] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420220/ [5420221] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420221/ [5420222] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420222/ [5420223] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420223/ [5420224] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:25:02 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420224/ [5420225] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420225/ [5420226] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420226/ [5420227] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420227/ [5420228] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420228/ [5420229] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:31:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420229/ [5420230] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420230/ [5420231] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:23:53 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420231/ [5420232] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420232/ [5420233] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420233/ [5420234] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:51:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420234/ [5420235] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-radosbench} time: 01:59:26 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420235/ [5420236] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420236/ [5420237] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420237/ [5420238] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:30:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420238/ [5420239] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420239/ [5420240] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:07:32 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420240/ [5420241] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420241/ [5420242] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:35 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420242/ [5420243] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420243/ [5420244] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420244/ [5420245] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:22:58 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420245/ [5420246] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420246/ [5420247] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420247/ [5420248] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:01:32 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420248/ [5420249] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:05:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420249/ [5420250] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420250/ [5420251] rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420251/ [5420252] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420252/ [5420253] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420253/ [5420254] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420254/ [5420255] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420255/ [5420256] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420256/ [5420257] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{centos_8}} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420257/ [5420258] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:16:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420258/ [5420259] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420259/ [5420260] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420260/ [5420261] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420261/ [5420262] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420262/ [5420263] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420263/ [5420264] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/progress} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420264/ [5420265] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420265/ [5420266] rados/singleton/{all/peer msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:05:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420266/ [5420267] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420267/ [5420268] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420268/ [5420269] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420269/ [5420270] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:43:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420270/ [5420271] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:33:58 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420271/ [5420272] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{centos_8}} time: 00:09:13 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420272/ [5420273] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420273/ [5420274] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:05:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420274/ [5420275] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:13 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420275/ [5420276] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:25:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420276/ [5420277] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420277/ [5420278] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420278/ [5420279] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420279/ [5420280] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:01:02 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420280/ [5420281] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:26:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420281/ [5420282] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:33:26 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420282/ [5420283] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420283/ [5420284] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420284/ [5420285] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420285/ [5420286] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420286/ [5420287] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:46:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420287/ [5420288] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:05:40 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420288/ [5420289] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420289/ [5420290] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420290/ [5420291] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}} time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420291/ [5420292] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420292/ [5420293] rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420293/ [5420294] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:21:07 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420294/ [5420295] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420295/ [5420296] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420296/ [5420297] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420297/ [5420298] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420298/ [5420299] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_5925} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420299/ [5420300] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420300/ [5420301] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420301/ [5420302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:22:20 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420302/ [5420303] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420303/ [5420304] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:05:07 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420304/ [5420305] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{centos_8}} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420305/ [5420306] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420306/ [5420307] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:35 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420307/ [5420308] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420308/ [5420309] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420309/ [5420310] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420310/ [5420311] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420311/ [5420312] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420312/ [5420313] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:36 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420313/ [5420314] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:17:45 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420314/ [5420315] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420315/ [5420316] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2} time: 00:16:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420316/ [5420317] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:57:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420317/ [5420318] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:05:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420318/ [5420319] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420319/ [5420320] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420320/ [5420321] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/workunits} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420321/ [5420323] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:32:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420323/ [5420324] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420324/ [5420325] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420325/ [5420326] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:45 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420326/ [5420327] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420327/ [5420328] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420328/ [5420329] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{rhel_8}} time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420329/ [5420330] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:29:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420330/ [5420331] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420331/ [5420332] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420332/ [5420333] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420333/ [5420334] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420334/ [5420335] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420335/ [5420336] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420336/ [5420337] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420337/ [5420338] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:20:07 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420338/ [5420339] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420339/ [5420340] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420340/ [5420341] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420341/ [5420342] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420342/ [5420343] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:26:10 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420343/ [5420344] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420344/ [5420345] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420345/ [5420346] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420346/ [5420347] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:05:09 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420347/ [5420348] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:32:27 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420348/ [5420349] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:08:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420349/ [5420350] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:01:33 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420350/ [5420351] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420351/ [5420352] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420352/ [5420353] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:17 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420353/ [5420354] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:22:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420354/ [5420355] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420355/ [5420356] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420356/ [5420357] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420357/ [5420358] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420358/ [5420359] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 01:09:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420359/ [5420360] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 02:22:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420360/ [5420361] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:50:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420361/ [5420362] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:17:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420362/ [5420363] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:30:46 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420363/ [5420364] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420364/ [5420365] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:04:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420365/ [5420366] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420366/ [5420367] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:27:50 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420367/ [5420368] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420368/ [5420369] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420369/ [5420370] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420370/ [5420371] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420371/ [5420372] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420372/ [5420373] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:35:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420373/ [5420374] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420374/ [5420375] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420375/ [5420376] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:22:29 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420376/ [5420377] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420377/ [5420378] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420378/ [5420379] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:26:31 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420379/ [5420380] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/failover} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420380/ [5420381] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{centos_8}} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420381/ [5420382] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:24:35 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420382/ [5420383] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420383/ [5420384] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 00:58:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420384/ [5420385] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:25:33 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420385/ [5420386] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2} time: 00:17:07 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420386/ [5420387] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420387/ [5420388] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420388/ [5420389] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:29:22 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420389/ [5420390] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420390/ [5420391] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:07:32 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420391/ [5420392] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420392/ [5420393] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420393/ [5420394] rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420394/ [5420395] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420395/ [5420396] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420396/ [5420397] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_8}} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420397/ [5420398] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420398/ [5420399] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:16 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420399/ [5420400] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420400/ [5420401] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420401/ [5420402] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:05:25 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420402/ [5420403] rados/singleton/{all/deduptool msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420403/ [5420404] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:33:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420404/ [5420405] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420405/ [5420406] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420406/ [5420407] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420407/ [5420408] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420408/ [5420409] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:31:47 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420409/ [5420410] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420410/ [5420411] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420411/ [5420412] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420412/ [5420413] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420413/ [5420414] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420414/ [5420415] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} time: 00:29:54 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420415/ [5420416] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420416/ [5420417] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:23 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420417/ [5420418] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:56:39 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420418/ [5420419] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:08:42 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420419/ [5420420] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:53 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420420/ [5420421] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420421/ [5420422] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} time: 00:31:05 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420422/ [5420423] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420423/ [5420424] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420424/ [5420425] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420425/ [5420426] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420426/ [5420427] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420427/ [5420428] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:05:01 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420428/ [5420429] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420429/ [5420430] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420430/ [5420431] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420431/ [5420432] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420432/ [5420433] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:56 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420433/ [5420434] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420434/ [5420435] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:32 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420435/ [5420436] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:29:40 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420436/ [5420437] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420437/ [5420438] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420438/ [5420439] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:41:03 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420439/ [5420440] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420440/ [5420441] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-09-10_07:01:02-rados-master-distro-basic-smithi/5420441/