2020-09-05T07:32:07.211 INFO:root:teuthology version: 1.0.0-c6539b8 2020-09-05T07:32:07.213 INFO:teuthology.results:subset: '1/8' 2020-09-05T07:32:07.213 INFO:teuthology.results:seed: '4889' 2020-09-05T09:24:45.266 INFO:root:teuthology version: 1.0.0-c6539b8 2020-09-05T09:24:45.304 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-09-05T21:23:05.343 INFO:teuthology.results:Tests finished! gathering results... 2020-09-05T21:23:15.518 INFO:scrape:Found 99 jobs 2020-09-05T21:23:36.068 INFO:scrape:Found 10 distinct failure reasons 2020-09-05T21:23:36.069 INFO:scrape:Dead: b'2020-09-05T19:38:14.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 6, have 1)...' 2020-09-05T21:23:36.070 INFO:scrape:11 jobs: ['5407895', '5407901', '5407976', '5407937', '5407929', '5407898', '5407912', '5407972', '5407951', '5407962', '5407891'] 2020-09-05T21:23:36.070 INFO:scrape: 2020-09-05T21:23:36.071 INFO:scrape:Failure: SSH connection to smithi074 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' 2020-09-05T21:23:36.071 INFO:scrape:29 jobs: ['5407924', '5407899', '5407934', '5407963', '5407889', '5407939', '5407913', '5407928', '5407975', '5407971', '5407910', '5407903', '5407922', '5407938', '5407900', '5407967', '5407940', '5407955', '5407945', '5407968', '5407966', '5407886', '5407957', '5407892', '5407904', '5407952', '5407887', '5407935', '5407911'] 2020-09-05T21:23:36.072 INFO:scrape:suites intersection: ['conf/{client', 'k-testing}', 'log-config', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.073 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'conf/{client', 'inline/no', 'inline/yes', 'k-testing}', 'kcephfs/cephfs/{begin', 'kcephfs/mixed-clients/{begin', 'kcephfs/thrash/{begin', 'kclient-overrides/{distro/testing/{flavor/ubuntu_latest', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/kclient_workunit_direct_io}', 'tasks/kclient_workunit_kernel_untar_build}', 'tasks/kclient_workunit_misc}', 'tasks/kclient_workunit_o_trunc}', 'tasks/kclient_workunit_snaps}', 'tasks/kclient_workunit_suites_ffsb}', 'tasks/kclient_workunit_suites_fsstress}', 'tasks/kclient_workunit_suites_fsx}', 'tasks/kclient_workunit_suites_fsync}', 'tasks/kclient_workunit_suites_iozone}', 'tasks/kclient_workunit_trivial_sync}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'thrash-health-whitelist', 'thrashers/default', 'thrashers/mds', 'thrashers/mon', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}', 'workloads/kclient_workunit_suites_iozone}'] 2020-09-05T21:23:36.073 INFO:scrape: 2020-09-05T21:23:36.074 INFO:scrape:Dead: b'2020-09-05T19:52:02.863 DEBUG:teuthology.exit:Finished running handlers' 2020-09-05T21:23:36.074 INFO:scrape:2 jobs: ['5407919', '5407933'] 2020-09-05T21:23:36.075 INFO:scrape:suites intersection: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.075 INFO:scrape:suites union: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/forward-scrub}', 'tasks/pool-perm}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.076 INFO:scrape: 2020-09-05T21:23:36.076 INFO:scrape:Failure: Command failed on smithi025 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2020-09-05T21:23:36.076 INFO:scrape:4 jobs: ['5407909', '5407888', '5407941', '5407982'] 2020-09-05T21:23:36.077 INFO:scrape:suites intersection: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.077 INFO:scrape:suites union: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/damage}', 'tasks/mds-full}', 'tasks/strays}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.078 INFO:scrape: 2020-09-05T21:23:36.078 INFO:scrape:Failure: Test failure: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-09-05T21:23:36.079 INFO:scrape:2 jobs: ['5407905', '5407958'] 2020-09-05T21:23:36.079 INFO:scrape:suites intersection: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/client-recovery}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.080 INFO:scrape:suites union: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/client-recovery}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.080 INFO:scrape: 2020-09-05T21:23:36.080 INFO:scrape:Failure: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2020-09-05T21:23:36.081 INFO:scrape:3 jobs: ['5407973', '5407920', '5407893'] 2020-09-05T21:23:36.081 INFO:scrape:suites intersection: ['clusters/1-mds-1-client', 'conf/{client', 'inline/no', 'k-testing}', 'kcephfs/cephfs/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{frag_enable', 'tasks/acls-kernel-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.082 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'conf/{client', 'inline/no', 'k-testing}', 'kcephfs/cephfs/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/acls-kernel-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.082 INFO:scrape: 2020-09-05T21:23:36.083 INFO:scrape:Failure: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2020-09-05T21:23:36.083 INFO:scrape:1 jobs: ['5407965'] 2020-09-05T21:23:36.083 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/data-scan}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.084 INFO:scrape: 2020-09-05T21:23:36.084 INFO:scrape:Failure: Test failure: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) 2020-09-05T21:23:36.085 INFO:scrape:1 jobs: ['5407923'] 2020-09-05T21:23:36.085 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.086 INFO:scrape: 2020-09-05T21:23:36.086 INFO:scrape:Failure: Test failure: test_15303 (tasks.cephfs.test_volume_client.TestVolumeClient) 2020-09-05T21:23:36.086 INFO:scrape:1 jobs: ['5407944'] 2020-09-05T21:23:36.087 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/volume-client}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.087 INFO:scrape: 2020-09-05T21:23:36.088 INFO:scrape:Failure: Test failure: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) 2020-09-05T21:23:36.088 INFO:scrape:1 jobs: ['5407954'] 2020-09-05T21:23:36.089 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/client-limits}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-09-05T21:23:36.089 INFO:scrape: 2020-09-05T21:23:36.101 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/ failed: 6 dead: 49 running: 0 waiting: 0 queued: 0 passed: 44 Fail ================================================================= [5407888] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays} ----------------------------------------------------------------- time: 00:03:47 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407888/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407888/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=883be31687cb43efa755c83b4cd7b262 Command failed on smithi176 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr- devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5407905] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} ----------------------------------------------------------------- time: 00:22:57 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407905/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407905/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=d0907135819546079b03811c5d1a72ac Test failure: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) [5407909] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/damage} ----------------------------------------------------------------- time: 00:03:50 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407909/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407909/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=e9f7d1c2514742babfac79914047af64 Command failed on smithi025 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr- devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5407941] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/strays} ----------------------------------------------------------------- time: 00:03:47 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407941/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407941/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=4b932ee831574d0da6cb00fad56e396a Command failed on smithi192 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr- devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5407958] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} ----------------------------------------------------------------- time: 00:22:53 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407958/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407958/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=71ec5cf02d184e28b5ca7c262fb9d0f3 Test failure: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) [5407982] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} ----------------------------------------------------------------- time: 00:03:40 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407982/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407982/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=a5dbbe9166fe4be98fdac5cbb7df099f Command failed on smithi187 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr- devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' Dead ================================================================= [5407886] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:27:52 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407886/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407886/ SSH connection to smithi071 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407887] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} ----------------------------------------------------------------- time: 00:25:25 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407887/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407887/ SSH connection to smithi141 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407889] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:26:09 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407889/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407889/ SSH connection to smithi033 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407891] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407891/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407891/ [5407892] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:25:07 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407892/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407892/ SSH connection to smithi038 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407893] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} ----------------------------------------------------------------- time: 00:23:02 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407893/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407893/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=ee98bcc1f67d411a99e72367caa144c6 Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) [5407895] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407895/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407895/ [5407898] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407898/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407898/ [5407899] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 01:00:09 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407899/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407899/ SSH connection to smithi075 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407900] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} ----------------------------------------------------------------- time: 00:38:57 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407900/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407900/ SSH connection to smithi112 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407901] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407901/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407901/ [5407903] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:26:10 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407903/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407903/ SSH connection to smithi190 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407904] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} ----------------------------------------------------------------- time: 01:08:44 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407904/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407904/ SSH connection to smithi174 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407910] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:25:29 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407910/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407910/ SSH connection to smithi120 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407911] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:33:34 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407911/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407911/ SSH connection to smithi135 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407912] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407912/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407912/ [5407913] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:34:50 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407913/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407913/ SSH connection to smithi092 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407919] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407919/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407919/ [5407920] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} ----------------------------------------------------------------- time: 00:23:19 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407920/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407920/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=1be9e39d063e42e19f0d8a5c0b2b53cb Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) [5407922] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:27:08 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407922/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407922/ SSH connection to smithi043 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407923] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} ----------------------------------------------------------------- time: 00:25:44 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407923/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407923/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=bc8472e18cc940908f6108503618ab06 Test failure: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) [5407924] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} ----------------------------------------------------------------- time: 00:25:07 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407924/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407924/ SSH connection to smithi074 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407928] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} ----------------------------------------------------------------- time: 00:34:12 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407928/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407928/ SSH connection to smithi076 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407929] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407929/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407929/ [5407933] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407933/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407933/ [5407934] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:34:09 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407934/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407934/ SSH connection to smithi067 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407935] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:50:10 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407935/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407935/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=bb61b4b7c21b433a9b7ab9b2a8f7cc75 SSH connection to smithi022 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407937] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407937/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407937/ [5407938] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:28:06 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407938/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407938/ SSH connection to smithi006 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407939] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:27:13 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407939/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407939/ SSH connection to smithi104 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407940] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} ----------------------------------------------------------------- time: 00:25:37 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407940/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407940/ SSH connection to smithi183 was lost: 'sudo rm /etc/logrotate.d/ceph- test.conf' [5407944] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} ----------------------------------------------------------------- time: 00:25:04 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407944/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407944/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=96350c45341543feb7f9a82a0b1a59ed Test failure: test_15303 (tasks.cephfs.test_volume_client.TestVolumeClient) [5407945] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:24:22 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407945/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407945/ SSH connection to smithi070 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407951] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407951/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407951/ [5407952] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 01:14:05 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407952/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407952/ SSH connection to smithi107 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407954] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} ----------------------------------------------------------------- time: 00:25:21 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407954/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407954/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=80ef96d020b2495595f24331ec94ffc9 Test failure: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) [5407955] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} ----------------------------------------------------------------- time: 00:34:48 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407955/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407955/ SSH connection to smithi194 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407957] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} ----------------------------------------------------------------- time: 00:46:11 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407957/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407957/ SSH connection to smithi106 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407962] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/damage} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407962/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407962/ [5407963] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:26:59 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407963/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407963/ SSH connection to smithi086 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407965] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} ----------------------------------------------------------------- time: 00:25:23 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407965/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407965/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=4a0a0f6a60a54505b61334937aebd6e5 Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) [5407966] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mon workloads/kclient_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:30:53 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407966/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407966/ SSH connection to smithi184 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407967] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} ----------------------------------------------------------------- time: 00:25:12 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407967/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407967/ SSH connection to smithi017 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407968] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:26:53 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407968/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407968/ SSH connection to smithi150 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407971] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} ----------------------------------------------------------------- time: 00:24:54 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407971/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407971/ SSH connection to smithi154 was lost: 'sudo PATH=/usr/sbin:$PATH lsof ; ps auxf' [5407972] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407972/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407972/ [5407973] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} ----------------------------------------------------------------- time: 00:24:07 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407973/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407973/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=4ea3bca8192841449d801c42a9630208 Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) [5407975] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_iozone} ----------------------------------------------------------------- time: 00:28:57 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407975/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407975/ SSH connection to smithi203 was lost: 'sudo rm /etc/logrotate.d/ceph- test.conf' [5407976] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407976/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407976/ Pass ================================================================= [5407890] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:11:15 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407890/ [5407894] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:34:32 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407894/ [5407896] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_ffsb} time: 00:51:14 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407896/ [5407897] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:11:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407897/ [5407902] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} time: 00:20:23 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407902/ [5407906] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} time: 00:57:05 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407906/ [5407907] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} time: 01:15:26 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407907/ [5407908] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:28:37 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407908/ [5407914] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsync} time: 00:11:46 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407914/ [5407915] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} time: 00:12:14 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407915/ [5407916] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover} time: 00:25:54 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407916/ [5407917] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:11:15 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407917/ [5407918] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_trivial_sync} time: 00:09:47 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407918/ [5407921] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:35:51 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407921/ [5407925] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} time: 00:33:35 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407925/ [5407926] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} time: 00:11:48 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407926/ [5407927] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} time: 00:53:05 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407927/ [5407930] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_ffsb} time: 01:08:38 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407930/ [5407931] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} time: 00:56:07 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407931/ [5407932] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} time: 01:28:41 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407932/ [5407936] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsstress} time: 00:14:23 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407936/ [5407942] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_iozone} time: 00:15:34 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407942/ [5407943] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:10:30 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407943/ [5407946] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/acls-kernel-client} time: 00:10:54 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407946/ [5407947] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:32:12 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407947/ [5407948] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} time: 00:12:38 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407948/ [5407949] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/default workloads/kclient_workunit_suites_ffsb} time: 01:01:27 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407949/ [5407950] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:08:11 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407950/ [5407953] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} time: 00:33:00 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407953/ [5407956] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_iozone} time: 00:19:34 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407956/ [5407959] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_dbench} time: 01:21:40 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407959/ [5407960] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_ffsb} time: 00:59:06 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407960/ [5407961] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 01:11:49 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407961/ [5407964] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_fsx} time: 00:22:54 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407964/ [5407969] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover} time: 00:26:09 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407969/ [5407970] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_suites_pjd} time: 00:11:39 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407970/ [5407974] kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:39:35 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407974/ [5407977] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_direct_io} time: 00:10:46 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407977/ [5407978] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_kernel_untar_build} time: 00:43:58 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407978/ [5407979] kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} time: 00:12:08 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407979/ [5407980] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} time: 00:46:46 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407980/ [5407981] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/no kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} time: 00:20:59 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407981/ [5407983] kcephfs/thrash/{begin clusters/1-mds-1-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts thrash-health-whitelist whitelist_health whitelist_wrongly_marked_down} thrashers/mds workloads/kclient_workunit_suites_ffsb} time: 00:43:49 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407983/ [5407984] kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_snaps} time: 01:03:03 info: http://pulpito.ceph.com/pdonnell-2020-09-05_05:32:35-kcephfs-wip-pdonnell-testing-20200904.221904-distro-basic-smithi/5407984/