Found 4 jobs
Missing teuthology log /home/teuthworker/archive/xiubli-2023-03-16_00:26:19-fs:workload-wip-20230315-1512-unlink-distro-default-smithi/7209807/teuthology.log
Found 4 distinct failure reasons
Dead: None
1 jobs: ['7209807']

Dead: b'2023-03-16T13:48:27.912 INFO:journalctl@ceph.mon.a.smithi090.stdout:Mar 16 13:06:43 smithi090 ceph-mon[122429]: pgmap v19841: 129 pgs: 129 active+clean; 4.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s'
1 jobs: ['7209805']
suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/yes', '5-workunit/suites/pjd}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/3', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/no}']

Dead: b'2023-03-16T13:48:27.911 INFO:journalctl@ceph.osd.10.smithi165.stdout:Mar 16 11:01:28 smithi165 ceph-63756fba-c39f-11ed-9afb-001a4aab830c-osd-10[147533]: 2023-03-16T11:01:28.060+0000 7fc5a76be700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 ever on either front or back, first ping sent 2023-03-16T10:56:59.103633+0000 (oldest deadline 2023-03-16T10:57:19.103633+0000)'
1 jobs: ['7209804']
suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/no', '4-flush/no', '5-workunit/suites/pjd}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'n/3', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-quota}', 'wsync/no}']

Dead: b'2023-03-16T13:48:28.675 INFO:journalctl@ceph.osd.10.smithi112.stdout:Mar 16 10:51:56 smithi112 ceph-15961498-c39f-11ed-9afb-001a4aab830c-osd-10[116662]: 2023-03-16T10:51:56.901+0000 7f23ba2ef700 -1 osd.10 900 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 ever on either front or back, first ping sent 2023-03-16T10:44:49.958338+0000 (oldest deadline 2023-03-16T10:45:09.958338+0000)'
1 jobs: ['7209806']
suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-flush/no', '5-workunit/suites/pjd}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/3', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-no-extra-options}']