2022-09-27T13:39:56.054 INFO:root:teuthology version: 1.1.1.dev424+ga773b061
2022-09-27T13:39:56.056 INFO:teuthology.results:subset: '0/10000'
2022-09-27T13:39:56.056 INFO:teuthology.results:seed: '5895'
2022-09-27T13:47:14.934 INFO:root:teuthology version: 1.1.1.dev424+ga773b061
2022-09-27T13:47:14.940 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-09-27T17:18:31.671 INFO:teuthology.results:Tests finished! gathering results...
2022-09-27T17:18:32.389 INFO:scrape:Found 10 jobs
2022-09-27T17:18:32.529 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-15225-gdbaa5456 (dbaa5456080d809e41f7e1a8a3f403c9a48493bb) quincy (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xcc) [0x7fbf1610dbfe]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x1b0) [0x55a2d320f0ca]

2022-09-27T17:18:32.530 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:11.128 INFO:teuthology.orchestra.run.smithi037.stdout:34359738435
, 2022-09-27T13:58:11.140 INFO:teuthology.orchestra.run.smithi037.stdout:34359738435
, 2022-09-27T13:58:11.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738437 got 34359738435 for osd.3

2022-09-27T17:18:32.531 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:19.296 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2022-09-27T13:57:05.582503+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=5, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)
, 2022-09-27T13:58:19.297 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2022-09-27T13:57:12.825714+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=12, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)
, 2022-09-27T13:58:19.297 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2022-09-27T13:57:05.582503+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=5, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)

2022-09-27T17:18:32.554 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:59.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/crash -- .
, 2022-09-27T13:58:59.826 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/sjust-2022-09-27_06:48:31-crimson-rados-wip-sjust-testing-distro-default-smithi/7045229/remote/smithi049/crash
, 2022-09-27T13:58:59.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2022-09-27T17:18:32.556 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:59:06.798 DEBUG:teuthology.orchestra.run:got remote process result: 1
, 2022-09-27T13:59:06.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2022-09-27T13:59:06.813 INFO:teuthology.task.internal:Transferring archived files...

2022-09-27T17:18:32.595 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-15225-gdbaa5456 (dbaa5456080d809e41f7e1a8a3f403c9a48493bb) quincy (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xcc) [0x7fbf1610dbfe]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x1b0) [0x55a2d320f0ca]

2022-09-27T17:18:32.599 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:11.128 INFO:teuthology.orchestra.run.smithi037.stdout:34359738435
, 2022-09-27T13:58:11.140 INFO:teuthology.orchestra.run.smithi037.stdout:34359738435
, 2022-09-27T13:58:11.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738437 got 34359738435 for osd.3

2022-09-27T17:18:32.600 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:19.296 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2022-09-27T13:57:05.582503+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=5, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)
, 2022-09-27T13:58:19.297 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2022-09-27T13:57:12.825714+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=12, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)
, 2022-09-27T13:58:19.297 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2022-09-27T13:57:05.582503+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=5, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)

2022-09-27T17:18:32.601 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:59.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/crash -- .
, 2022-09-27T13:58:59.826 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/sjust-2022-09-27_06:48:31-crimson-rados-wip-sjust-testing-distro-default-smithi/7045229/remote/smithi049/crash
, 2022-09-27T13:58:59.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2022-09-27T17:18:32.602 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:59:06.798 DEBUG:teuthology.orchestra.run:got remote process result: 1
, 2022-09-27T13:59:06.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2022-09-27T13:59:06.813 INFO:teuthology.task.internal:Transferring archived files...

2022-09-27T17:18:32.643 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-15225-gdbaa5456 (dbaa5456080d809e41f7e1a8a3f403c9a48493bb) quincy (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xcc) [0x7fbf1610dbfe]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x1b0) [0x55a2d320f0ca]

2022-09-27T17:18:32.645 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:11.128 INFO:teuthology.orchestra.run.smithi037.stdout:34359738435
, 2022-09-27T13:58:11.140 INFO:teuthology.orchestra.run.smithi037.stdout:34359738435
, 2022-09-27T13:58:11.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738437 got 34359738435 for osd.3

2022-09-27T17:18:32.647 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:19.296 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2022-09-27T13:57:05.582503+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=5, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)
, 2022-09-27T13:58:19.297 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2022-09-27T13:57:12.825714+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=12, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)
, 2022-09-27T13:58:19.297 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2022-09-27T13:57:05.582503+0000 time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=57, tm_sec=5, tm_wday=1, tm_yday=270, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=9, tm_mday=27, tm_hour=13, tm_min=58, tm_sec=15, tm_wday=1, tm_yday=270, tm_isdst=0)

2022-09-27T17:18:32.647 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:58:59.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/crash -- .
, 2022-09-27T13:58:59.826 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/sjust-2022-09-27_06:48:31-crimson-rados-wip-sjust-testing-distro-default-smithi/7045229/remote/smithi049/crash
, 2022-09-27T13:58:59.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2022-09-27T17:18:32.648 WARNING:scrape:Ignoring malparsed backtrace: 2022-09-27T13:59:06.798 DEBUG:teuthology.orchestra.run:got remote process result: 1
, 2022-09-27T13:59:06.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2022-09-27T13:59:06.813 INFO:teuthology.task.internal:Transferring archived files...

2022-09-27T17:18:32.892 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/results.py", line 34, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/results.py", line 71, in results
    Scraper(archive_dir).analyze()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/scrape.py", line 490, in analyze
    if reason.match(job):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/scrape.py", line 75, in match
    if (self.backtrace is None) != (job.get_backtrace() is None):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/scrape.py", line 338, in get_backtrace
    self._populate_backtrace()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/scrape.py", line 384, in _populate_backtrace
    bt, ass = self._search_backtrace(GzipFile(gzipped_log_path))
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a773b0612ada07695bef890b85208fa310b79d30/teuthology/scrape.py", line 304, in _search_backtrace
    if ".stderr:" in line:
TypeError: a bytes-like object is required, not 'str'