2023-06-22T15:47:51.917 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-22T15:47:51.918 INFO:teuthology.results:subset: '111/120000'
2023-06-22T15:47:51.918 INFO:teuthology.results:seed: '1833'
2023-06-22T16:00:56.102 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-22T16:00:56.105 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-06-22T22:36:42.295 INFO:teuthology.results:Tests finished! gathering results...
2023-06-22T22:36:45.269 INFO:scrape:Found 7 jobs
2023-06-22T22:36:45.561 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 18.0.0-4378-gbab5f35c (bab5f35cc0c47b0fb5e8306e14706ece2bb53a74) reef (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xc6) [0x56690c]
,  2: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d const*, char const*, std::chrono::time_point<ceph::coarse_mono_clock, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > >)+0x25a) [0xba390a]

2023-06-22T22:36:45.561 WARNING:scrape:Ignoring malparsed backtrace: ==00:00:37:21.259 84832== Warning: unimplemented fcntl command: 1036
, 2023-06-22T16:59:44.885 INFO:tasks.workunit.client.0.smithi112.stdout:[ RUN      ] cls_rgw.index_basic
, 2023-06-22T16:59:45.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s

2023-06-22T22:36:45.562 WARNING:scrape:Ignoring malparsed backtrace: ==00:00:38:41.420 84824== Warning: unimplemented fcntl command: 1036
, ==00:00:38:41.406 84336== Warning: unimplemented fcntl command: 1036
, ==00:00:38:41.409 84336== Warning: unimplemented fcntl command: 1036

2023-06-22T22:36:45.562 WARNING:scrape:Ignoring malparsed backtrace: ==00:00:40:16.728 84832== Warning: unimplemented fcntl command: 1036
, ==00:00:40:16.687 84336== Warning: unimplemented fcntl command: 1036
, ==00:00:40:16.748 84832== Warning: unimplemented fcntl command: 1036

2023-06-22T22:36:45.563 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-22T17:04:01.635 INFO:tasks.ceph.osd.3:Sent signal 15
, 2023-06-22T17:04:01.636 INFO:tasks.ceph.osd.4:Sent signal 15
, 2023-06-22T17:04:01.636 INFO:tasks.ceph.osd.5:Sent signal 15

2023-06-22T22:36:45.563 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-22T20:01:43.303 DEBUG:teuthology.orchestra.run:got remote process result: 124
, 2023-06-22T20:01:43.304 ERROR:teuthology.contextutil:Saw exception from nested tasks
, Traceback (most recent call last):

2023-06-22T22:36:45.564 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last):
,   File "/home/teuthworker/src/github.com_ljflores_ceph_b9ba6beab620cc5d3589c8a6e91c2a79c3a383fc/qa/tasks/ceph.py", line 1469, in run_daemon
,     yield

2023-06-22T22:36:45.564 WARNING:scrape:Ignoring malparsed backtrace:     out = self.raw_cluster_cmd('pg', 'dump', '--format=json')
,   File "/home/teuthworker/src/github.com_ljflores_ceph_b9ba6beab620cc5d3589c8a6e91c2a79c3a383fc/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd
,     return self.run_cluster_cmd(**kwargs).stdout.getvalue()

2023-06-22T22:36:45.566 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-22T20:01:44.628 DEBUG:teuthology.orchestra.run.smithi112:> mktemp
, 2023-06-22T20:01:44.679 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.Jucbf51glB
, 2023-06-22T20:01:44.680 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Jucbf51glB

2023-06-22T22:36:45.567 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/valgrind/osd.2.log:	/var/log/ceph/valgrind/osd.1.log:	 63.8% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz
, gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90178.log
,  63.9% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz

2023-06-22T22:36:45.567 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.89514.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.89514.log.gz
, gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89192.log
, /var/log/ceph/ceph-client.admin.88893.log:	  0.0% -- replaced with /var/log/ceph/ceph-client.admin.88893.log.gz

2023-06-22T22:36:45.567 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/github.com_ljflores_ceph_b9ba6beab620cc5d3589c8a6e91c2a79c3a383fc/qa/tasks/ceph_manager.py", line 2744, in wait_for_clean
,     num_active_clean = self.get_num_active_clean()
,   File "/home/teuthworker/src/github.com_ljflores_ceph_b9ba6beab620cc5d3589c8a6e91c2a79c3a383fc/qa/tasks/ceph_manager.py", line 2576, in get_num_active_clean

2023-06-22T22:36:45.568 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-22T20:01:55.366 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers
, 2023-06-22T20:01:55.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump
, 2023-06-22T20:01:55.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump

2023-06-22T22:36:45.603 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/results.py", line 33, in main
    results(args['--archive-dir'], args['--name'], args['--email'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/results.py", line 71, in results
    Scraper(archive_dir).analyze()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 497, in analyze
    reasons[give_me_a_reason(job)].append(job)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 459, in give_me_a_reason
    if klass.could_be(job):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 147, in could_be
    if not super(LockdepReason, cls).could_be(job):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 132, in could_be
    return job.get_assertion() is not None
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 334, in get_assertion
    self._populate_backtrace()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 385, in _populate_backtrace
    bt, ass = self._search_backtrace(GzipFile(gzipped_log_path))
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/scrape.py", line 305, in _search_backtrace
    if ".stderr:" in line:
TypeError: a bytes-like object is required, not 'str'