Found 25 jobs Ignoring malparsed backtrace: ceph version 15.2.9-108-g1ff7d244 (1ff7d244fcbc15312e010f47e19e0e96c819755d) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f191e2db1a0] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f191e2db37b] Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/teuthology/orchestra/run.py", line 479, in wait , proc.wait() Ignoring malparsed backtrace: 2021-03-10T14:11:25.140 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 14:11:24 gibba023 systemd[1]: ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service: Main process exited, code=exited, status=143/n/a , 2021-03-10T14:11:26.703 DEBUG:teuthology.orchestra.run.gibba023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service' , 2021-03-10T14:11:26.714 DEBUG:teuthology.orchestra.run:got remote process result: None Ignoring malparsed backtrace: 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" Ignoring malparsed backtrace: ceph version 15.2.9-108-g1ff7d244 (1ff7d244fcbc15312e010f47e19e0e96c819755d) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f191e2db1a0] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f191e2db37b] Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/teuthology/orchestra/run.py", line 479, in wait , proc.wait() Ignoring malparsed backtrace: 2021-03-10T14:11:25.140 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 14:11:24 gibba023 systemd[1]: ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service: Main process exited, code=exited, status=143/n/a , 2021-03-10T14:11:26.703 DEBUG:teuthology.orchestra.run.gibba023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service' , 2021-03-10T14:11:26.714 DEBUG:teuthology.orchestra.run:got remote process result: None Ignoring malparsed backtrace: 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" Ignoring malparsed backtrace: ceph version 15.2.9-108-g1ff7d244 (1ff7d244fcbc15312e010f47e19e0e96c819755d) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f191e2db1a0] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f191e2db37b] Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/teuthology/orchestra/run.py", line 479, in wait , proc.wait() Ignoring malparsed backtrace: 2021-03-10T14:11:25.140 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 14:11:24 gibba023 systemd[1]: ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service: Main process exited, code=exited, status=143/n/a , 2021-03-10T14:11:26.703 DEBUG:teuthology.orchestra.run.gibba023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service' , 2021-03-10T14:11:26.714 DEBUG:teuthology.orchestra.run:got remote process result: None Ignoring malparsed backtrace: 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" Ignoring malparsed backtrace: ceph version 15.2.9-108-g1ff7d244 (1ff7d244fcbc15312e010f47e19e0e96c819755d) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f191e2db1a0] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f191e2db37b] Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/teuthology/orchestra/run.py", line 479, in wait , proc.wait() Ignoring malparsed backtrace: 2021-03-10T14:11:25.140 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 14:11:24 gibba023 systemd[1]: ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service: Main process exited, code=exited, status=143/n/a , 2021-03-10T14:11:26.703 DEBUG:teuthology.orchestra.run.gibba023:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b86325a2-81a8-11eb-9080-001a4aab830c@osd.3.service' , 2021-03-10T14:11:26.714 DEBUG:teuthology.orchestra.run:got remote process result: None Ignoring malparsed backtrace: 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" , 2021-03-10T14:11:50.311 INFO:journalctl@ceph.grafana.a.gibba028.stdout:Mar 10 14:11:50 gibba028 bash[25651]: t=2021-03-10T14:11:50+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" Found 2 distinct failure reasons Failure: Command failed on gibba028 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-octopus shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 833f5b8a-81b6-11eb-9080-001a4aab830c -- ceph orch host ls --format=json' 1 jobs: ['5953089'] suites: ['0-roles', '1-start', '2-first-half-tasks/readwrite', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_stable'] Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0' 1 jobs: ['5953079'] suites: ['0-start', '1-tasks', 'mon_election/classic', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api}}', 'upgrade-sequence', 'upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04', 'workload/{ec-rados-default']