2022-01-19T19:29:18.023 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-19T19:29:18.024 INFO:teuthology.results:subset: '111/120000' 2022-01-19T19:29:18.025 INFO:teuthology.results:seed: '4129' 2022-01-19T20:38:39.188 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-19T20:38:39.225 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-19T23:16:52.684 INFO:teuthology.results:Tests finished! gathering results... 2022-01-19T23:17:10.069 INFO:scrape:Found 164 jobs 2022-01-19T23:17:18.446 INFO:scrape:Found 7 distinct failure reasons 2022-01-19T23:17:18.447 INFO:scrape:Failure: everything on the same host must use the same kernel 2022-01-19T23:17:18.448 INFO:scrape:41 jobs 2022-01-19T23:17:18.449 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_wrongly_marked_down}'] 2022-01-19T23:17:18.449 INFO:scrape:suites union: ['2-workunit/cfuse_workunit_snaptests}}', '2-workunit/cfuse_workunit_suites_fsstress}}', '2-workunit/cfuse_workunit_suites_pjd}}', '2-workunit/cfuse_workunit_trivial_sync}}', '2-workunit/ffsb}}', '2-workunit/fs/trivial_sync}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/pjd}}', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/mixed-clients/{begin', 'fs/multifs/{begin', 'fs/snaps/{begin', 'fs/thrash/multifs/{begin', 'fs/thrash/workloads/{begin', 'fs/volumes/{begin', 'fs/workload/{begin', 'k-testing}', 'kclient-overrides/{distro/testing/{flavor/ubuntu_latest', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag', 'overrides/{mon-debug', 'overrides/{no_client_pidfile', 'overrides/{osd-asserts', 'overrides/{whitelist_health', 'races', 'ranks/1', 'ranks/3', 'ranks/5', 'rhel_8}', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/acls}', 'tasks/auto-repair}', 'tasks/client-readahead}', 'tasks/data-scan}', 'tasks/exports}', 'tasks/failover}', 'tasks/journal-repair}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'tasks/mds-flush}', 'tasks/mds-full}', 'tasks/mds_creation_retry}', 'tasks/multifs-auth}', 'tasks/openfiletable}', 'tasks/sessionmap}', 'tasks/test_journal_migration}', 'tasks/volumes/{overrides', 'tasks/workunit/snaps}', 'tasks/{0-check-counter', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'test/clone}}', 'test/misc}}', 'test/snapshot}}', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/misc}', 'workunit/fs/norstats}', 'workunit/fs/test_o_trunc}', 'workunit/kernel_untar_build}', 'workunit/suites/dbench}', 'workunit/suites/iozone}', 'wsync/{no}}', 'wsync/{yes}}'] 2022-01-19T23:17:18.450 INFO:scrape: 2022-01-19T23:17:18.450 INFO:scrape:Failure: Command failed on smithi111 with status 1: "sudo nsenter --net=/var/run/netns/ceph-ns-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id vol_data_isolated --client_mountpoint=/volumes/_nogroup/vol_isolated mnt.0" 2022-01-19T23:17:18.451 INFO:scrape:1 jobs: ['6627541'] 2022-01-19T23:17:18.451 INFO:scrape:suites: ['1-client', '2-upgrade', '3-verify}', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'tasks/{0-nautilus', 'ubuntu_18.04}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-19T23:17:18.452 INFO:scrape: 2022-01-19T23:17:18.452 INFO:scrape:Failure: "2022-01-19T19:55:05.339699+0000 mds.a (mds.1) 1 : cluster [ERR] error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory)" in cluster log 2022-01-19T23:17:18.452 INFO:scrape:1 jobs: ['6627438'] 2022-01-19T23:17:18.453 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-19T23:17:18.453 INFO:scrape: 2022-01-19T23:17:18.454 INFO:scrape:Failure: "2022-01-19T20:07:20.151364+0000 mon.a (mon.0) 366 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log 2022-01-19T23:17:18.454 INFO:scrape:3 jobs: ['6627481', '6627454', '6627497'] 2022-01-19T23:17:18.455 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_wrongly_marked_down}'] 2022-01-19T23:17:18.455 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'clusters/fixed-2-ucephfs', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/permission/{begin', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{no_client_pidfile', 'overrides/{whitelist_health', 'rhel_8}', 'tasks/cfuse_workunit_misc}', 'tasks/metrics}', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-19T23:17:18.456 INFO:scrape: 2022-01-19T23:17:18.456 INFO:scrape:Crash: Command failed (workunit test suites/fsync-tester.sh) on smithi146 with status 135: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d6615f74979a2b9297b48dc14582d7b541c29e00 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh' 2022-01-19T23:17:18.457 INFO:scrape:ceph version 16.2.7-238-gd6615f74 (d6615f74979a2b9297b48dc14582d7b541c29e00) pacific (stable) 1: /lib64/libpthread.so.0(+0x12b20) [0x7f5fff251b20] 2: gsignal() 3: abort() 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55b5a176b197] 5: (KernelDevice::_aio_thread()+0x11e9) [0x55b5a22bcf09] 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b5a22c8271] 7: /lib64/libpthread.so.0(+0x814a) [0x7f5fff24714a] 8: clone() 2022-01-19T23:17:18.457 INFO:scrape:1 jobs: ['6627568'] 2022-01-19T23:17:18.458 INFO:scrape:suites: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{rhel_8}', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'ranks/3', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/fsync-tester}', 'wsync/{no}}'] 2022-01-19T23:17:18.458 INFO:scrape: 2022-01-19T23:17:18.458 INFO:scrape:Failure: Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-b6a1226a-7963-11ec-8c34-001a4aab830c@mon.smithi049' 2022-01-19T23:17:18.459 INFO:scrape:1 jobs: ['6627489'] 2022-01-19T23:17:18.459 INFO:scrape:suites: ['1-mount', '2-workload/dbench', 'distro/centos_latest}', 'fs/cephadm/multivolume/{0-start'] 2022-01-19T23:17:18.460 INFO:scrape: 2022-01-19T23:17:18.460 INFO:scrape:Failure: Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2022-01-19T23:17:18.461 INFO:scrape:1 jobs: ['6627486'] 2022-01-19T23:17:18.461 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{no_client_pidfile', 'tasks/strays}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-19T23:17:18.462 INFO:scrape: 2022-01-19T23:17:18.469 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/ failed: 48 dead: 1 running: 0 waiting: 0 queued: 0 passed: 115 Fail ================================================================= [6627433] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627433/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627433/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91a167c054344062a927407494a086ad everything on the same host must use the same kernel [6627437] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627437/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627437/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a584173ec9a541b2b1d061e0a1d53323 everything on the same host must use the same kernel [6627438] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} ----------------------------------------------------------------- time: 00:20:33 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627438/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627438/ "2022-01-19T19:55:05.339699+0000 mds.a (mds.1) 1 : cluster [ERR] error reading sessionmap 'mds1_sessionmap' -2 ((2) No such file or directory)" in cluster log [6627444] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627444/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ae69c1d344241978ed6b546093ffad3 everything on the same host must use the same kernel [6627445] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627445/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=334f42f33e4043c79a8fa916b743e56a everything on the same host must use the same kernel [6627447] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627447/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627447/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89f24cde001a4215a273a617d244ea4a everything on the same host must use the same kernel [6627449] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627449/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627449/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5eca1d480f7f4630af8f225d8e85e6a0 everything on the same host must use the same kernel [6627454] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics} ----------------------------------------------------------------- time: 00:25:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627454/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627454/ "2022-01-19T20:04:02.176906+0000 mon.a (mon.0) 1217 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [6627455] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627455/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627455/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5071c372a2404aa59635f26405712191 everything on the same host must use the same kernel [6627459] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627459/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627459/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba8f013dc0f24a2bae5ee28df300e0e0 everything on the same host must use the same kernel [6627464] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627464/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627464/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5328931b48a2445a899c0b12e78001c6 everything on the same host must use the same kernel [6627466] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627466/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627466/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8332559fff18470b98685ea039c8591a everything on the same host must use the same kernel [6627470] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627470/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627470/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ef4e84a5cfd49989d43e710057008e7 everything on the same host must use the same kernel [6627472] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627472/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627472/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13817b59a15d47a699cade5a3a53cbdf everything on the same host must use the same kernel [6627476] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627476/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627476/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1787a6e5b8da482292382d8a7df64668 everything on the same host must use the same kernel [6627477] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627477/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627477/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f470ea58f52848f9aba7a31f5b00c7b3 everything on the same host must use the same kernel [6627478] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627478/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627478/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0afefd955595414d991fdcd3c9225d8a everything on the same host must use the same kernel [6627481] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} ----------------------------------------------------------------- time: 00:17:49 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627481/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627481/ "2022-01-19T20:07:20.151364+0000 mon.a (mon.0) 366 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log [6627484] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627484/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627484/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41aa650117d2434d9fab477d2dcaeb78 everything on the same host must use the same kernel [6627486] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays} ----------------------------------------------------------------- time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627486/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627486/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b7a077b1f17440090a8326305c9e455 Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) [6627489] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} ----------------------------------------------------------------- time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627489/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627489/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90f290cd4c31417c8860c8f74e0d5357 Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-b6a1226a-7963-11ec-8c34-001a4aab830c@mon.smithi049' [6627497] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:10:45 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627497/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627497/ "2022-01-19T20:11:36.869742+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [6627505] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627505/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=878af297908943169789483db29ec5fc everything on the same host must use the same kernel [6627515] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627515/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627515/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e66e1f52feb644ddb1410afab7e8ce82 everything on the same host must use the same kernel [6627516] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627516/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff4fda26e7ab474989506fc0018e7665 everything on the same host must use the same kernel [6627517] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627517/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627517/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f1ad5fff4e9b4f48bdd70fe87bac64bc everything on the same host must use the same kernel [6627533] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627533/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627533/ sentry: https://sentry.ceph.com/organizations/ceph/?query=838cd32f56a4446ea21f43ebd4272f02 everything on the same host must use the same kernel [6627535] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627535/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627535/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c1c5b662b0a8430eb0e7f7dafc336715 everything on the same host must use the same kernel [6627536] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627536/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=284bdb267bc44a51b9411d6c681ec1a6 everything on the same host must use the same kernel [6627537] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627537/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b986f5cd9ac47e6888465a388624fc7 everything on the same host must use the same kernel [6627541] fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} ----------------------------------------------------------------- time: 00:09:17 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627541/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627541/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7baa98a542994d64b092154df34964e4 Command failed on smithi111 with status 1: "sudo nsenter --net=/var/run/netns/ceph-ns-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id vol_data_isolated --client_mountpoint=/volumes/_nogroup/vol_isolated mnt.0" [6627546] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627546/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627546/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc3c818df02e4873894e507272195400 everything on the same host must use the same kernel [6627550] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627550/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627550/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3def697119a44ec988511e7e014e18fd everything on the same host must use the same kernel [6627553] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627553/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627553/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57291a532b9542ec9c3bfc400ff70cd5 everything on the same host must use the same kernel [6627554] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627554/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627554/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc5976386f0042f792f8ee399fe88892 everything on the same host must use the same kernel [6627558] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627558/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627558/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e33b1436ad28487190133ad3f4a4ff54 everything on the same host must use the same kernel [6627563] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627563/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627563/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d843d0ca09dc47d6b771ebfb1831812c everything on the same host must use the same kernel [6627564] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627564/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddcdb3d3ecd84e598fd27774f8294976 everything on the same host must use the same kernel [6627569] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627569/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627569/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bc48f6abb8a4fc89906a7360c134922 everything on the same host must use the same kernel [6627570] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627570/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627570/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05f798be3ce2463c9394ee87bc125570 everything on the same host must use the same kernel [6627571] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627571/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627571/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ded424ca668342479d112a32e267b16f everything on the same host must use the same kernel [6627581] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627581/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627581/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b2270c2835c4ce7bca768a75a54bfb2 everything on the same host must use the same kernel [6627583] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627583/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627583/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26b75691892c46378da1c14192fb1e51 everything on the same host must use the same kernel [6627584] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627584/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627584/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c1bf277833fa40bc98f7b0f393c530ed everything on the same host must use the same kernel [6627586] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627586/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627586/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f038b9c697ae4785852fcfe247d0172d everything on the same host must use the same kernel [6627587] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627587/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627587/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7afbe981949d4dbaaa27beb77f9276c4 everything on the same host must use the same kernel [6627594] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627594/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627594/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f89fcea44664bc6b4e59f258b17cf9e everything on the same host must use the same kernel [6627595] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627595/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e8d57e338ba74370ace4c7975272a52d everything on the same host must use the same kernel Dead ================================================================= [6627568] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{no}} ----------------------------------------------------------------- time: 00:57:07 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627568/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627568/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf7d7ef6043b4d5b85083d4e4dd01ec1 Command failed (workunit test suites/fsync-tester.sh) on smithi146 with status 135: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d6615f74979a2b9297b48dc14582d7b541c29e00 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh' Pass ================================================================= [6627432] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627432/ [6627434] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:58:27 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627434/ [6627435] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/valgrind} time: 01:00:05 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627435/ [6627436] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}} time: 00:41:36 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627436/ [6627439] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:31:47 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627439/ [6627440] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} time: 00:12:07 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627440/ [6627441] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:25:51 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627441/ [6627442] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} time: 00:13:58 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627442/ [6627443] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627443/ [6627446] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:22:00 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627446/ [6627448] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627448/ [6627450] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627450/ [6627451] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627451/ [6627452] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627452/ [6627453] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:19:52 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627453/ [6627456] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627456/ [6627457] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc} time: 00:20:10 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627457/ [6627458] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:24:11 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627458/ [6627460] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} time: 00:36:28 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627460/ [6627461] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:31:14 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627461/ [6627462] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:19:05 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627462/ [6627463] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627463/ [6627465] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} time: 00:11:49 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627465/ [6627467] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627467/ [6627468] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:39 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627468/ [6627469] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627469/ [6627471] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627471/ [6627473] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627473/ [6627474] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627474/ [6627475] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627475/ [6627479] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:24:39 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627479/ [6627480] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} time: 01:54:36 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627480/ [6627482] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}} time: 00:14:27 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627482/ [6627483] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots} time: 00:24:13 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627483/ [6627485] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627485/ [6627487] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627487/ [6627488] fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627488/ [6627490] fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full} time: 00:19:35 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627490/ [6627491] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} time: 00:10:58 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627491/ [6627492] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{rhel_8} tasks/mirror} time: 01:58:57 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627492/ [6627493] fs/mirror-ha/{begin cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 02:35:36 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627493/ [6627494] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:35:18 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627494/ [6627495] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627495/ [6627496] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} time: 00:30:47 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627496/ [6627498] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell} time: 00:36:37 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627498/ [6627499] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:47:30 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627499/ [6627500] fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{rhel_8} tasks/fstop} time: 00:13:30 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627500/ [6627501] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627501/ [6627502] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} time: 00:34:17 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627502/ [6627503] fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} time: 02:16:43 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627503/ [6627504] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} time: 00:30:43 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627504/ [6627506] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:47:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627506/ [6627507] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/valgrind} time: 00:58:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627507/ [6627508] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} time: 00:20:21 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627508/ [6627509] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay} time: 00:16:55 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627509/ [6627510] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:21:58 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627510/ [6627511] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/dir-max-entries} time: 03:12:14 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627511/ [6627512] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:22:14 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627512/ [6627513] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:43 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627513/ [6627514] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627514/ [6627518] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627518/ [6627519] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:17:29 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627519/ [6627520] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:18:20 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627520/ [6627521] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} time: 00:51:11 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627521/ [6627522] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} time: 00:52:04 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627522/ [6627523] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:28:12 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627523/ [6627524] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627524/ [6627525] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}} time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627525/ [6627526] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:16:32 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627526/ [6627527] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}} time: 00:39:55 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627527/ [6627528] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool} time: 00:14:46 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627528/ [6627529] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} time: 00:51:48 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627529/ [6627530] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:54:12 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627530/ [6627531] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 01:07:48 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627531/ [6627532] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree} time: 00:24:31 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627532/ [6627534] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep} time: 00:22:43 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627534/ [6627538] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627538/ [6627539] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} time: 00:11:25 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627539/ [6627540] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:17:11 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627540/ [6627542] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627542/ [6627543] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}} time: 00:32:52 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627543/ [6627544] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627544/ [6627545] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} time: 01:18:14 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627545/ [6627547] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627547/ [6627548] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627548/ [6627549] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:18:32 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627549/ [6627551] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627551/ [6627552] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627552/ [6627555] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} time: 00:33:49 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627555/ [6627556] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} time: 00:26:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627556/ [6627557] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627557/ [6627559] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:16:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627559/ [6627560] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:41:48 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627560/ [6627561] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:46:13 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627561/ [6627562] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627562/ [6627565] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:23 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627565/ [6627566] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/valgrind} time: 00:51:08 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627566/ [6627567] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} time: 00:23:44 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627567/ [6627572] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627572/ [6627573] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627573/ [6627574] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment} time: 00:19:42 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627574/ [6627575] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627575/ [6627576] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs/{frag test}} time: 00:14:52 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627576/ [6627577] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} time: 01:37:48 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627577/ [6627578] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:19:23 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627578/ [6627579] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:12:13 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627579/ [6627580] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:23:47 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627580/ [6627582] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:20:24 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627582/ [6627585] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:24:55 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627585/ [6627588] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:16:39 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627588/ [6627589] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} time: 00:31:56 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627589/ [6627590] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} time: 00:19:52 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627590/ [6627591] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:17:55 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627591/ [6627592] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} time: 00:28:57 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627592/ [6627593] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}} time: 00:24:45 info: http://pulpito.ceph.com/yuriw-2022-01-19_19:27:28-fs-wip-yuri5-testing-2022-01-19-0916-pacific-distro-default-smithi/6627593/