2023-07-08T15:09:11.185 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T15:09:11.186 INFO:teuthology.results:subset: '111/120000' 2023-07-08T15:09:11.187 INFO:teuthology.results:seed: '5670' 2023-07-08T18:46:33.004 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T18:46:33.032 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-09T06:25:42.485 INFO:teuthology.results:Tests finished! gathering results... 2023-07-09T06:26:01.600 INFO:scrape:Found 194 jobs 2023-07-09T06:26:05.479 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329558/teuthology.log 2023-07-09T06:26:11.663 WARNING:scrape:Misunderstood line: 2023-07-09T06:26:14.974 INFO:scrape:Found 12 distinct failure reasons 2023-07-09T06:26:14.975 INFO:scrape:Dead: b'2023-07-09T06:22:21.474 DEBUG:teuthology.exit:Finished running handlers' 2023-07-09T06:26:14.975 INFO:scrape:3 jobs: ['7329533', '7329406', '7329386'] 2023-07-09T06:26:14.975 INFO:scrape:suites intersection: ['2-logrotate}', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}'] 2023-07-09T06:26:14.976 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '2-workunit/suites/fsstress}}', '3-snaps/no', '4-flush/yes', '5-workunit/suites/fsstress}}', 'begin/{0-install', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_20.04}', 'frag', 'fs/fscrypt/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v2}', 'mount/kclient/{mount-syntax/v1', 'ms-die-on-skipped}}', 'ms_mode/crc', 'msgr-failures/none', 'n/5', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{distro/testing/k-testing}}', 'overrides/{frag', 'overrides/{ignorelist_health', 'pg-warn}', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout', 'session_timeout}', 'standby-replay', 'tasks/fscrypt-common}', 'tasks/{0-subvolume/{no-subvolume}', 'tasks/{1-thrash/osd', 'thrashosds-health}', 'wsync/no}'] 2023-07-09T06:26:14.976 INFO:scrape: 2023-07-09T06:26:14.976 INFO:scrape:Failure: Command failed on smithi100 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-07-09T06:26:14.977 INFO:scrape:7 jobs: ['7329457', '7329426', '7329389', '7329522', '7329552', '7329392', '7329448'] 2023-07-09T06:26:14.977 INFO:scrape:suites intersection: ['2-logrotate}', 'conf/{client', 'mds', 'mon', 'osd}'] 2023-07-09T06:26:14.977 INFO:scrape:suites union: ['1-ceph', '1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/no', '4-flush/yes', '5-workunit/direct_io}}', 'begin/{0-install', 'clusters/1-mds-1-client-coloc', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'distros/ubuntu_latest', 'frag', 'fs/libcephfs/{begin/{0-install', 'fs/mixed-clients/{begin/{0-install', 'fs/multiclient/{begin/{0-install', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'kclient-overrides/{distro/stock/{k-stock', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'no_client_pidfile}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd-asserts}', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'ranks/1', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/client}', 'tasks/ior-shared-file}', 'tasks/kernel_cfuse_workunits_dbench_iozone}', 'tasks/mdtest}', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/no}'] 2023-07-09T06:26:14.978 INFO:scrape: 2023-07-09T06:26:14.978 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/suites/fsstress.sh 2023-07-09T06:26:14.978 INFO:scrape:1 jobs: ['7329474'] 2023-07-09T06:26:14.979 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/suites/fsstress}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'msgr-failures/none', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health}'] 2023-07-09T06:26:14.979 INFO:scrape: 2023-07-09T06:26:14.979 INFO:scrape:Failure: "2023-07-08T17:48:55.638410+0000 mon.a (mon.0) 2852 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2023-07-09T06:26:14.980 INFO:scrape:2 jobs: ['7329451', '7329527'] 2023-07-09T06:26:14.980 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health'] 2023-07-09T06:26:14.981 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/admin}', 'tasks/metrics}'] 2023-07-09T06:26:14.981 INFO:scrape: 2023-07-09T06:26:14.981 INFO:scrape:Dead: None 2023-07-09T06:26:14.982 INFO:scrape:2 jobs: ['7329558', '7329490'] 2023-07-09T06:26:14.982 INFO:scrape: 2023-07-09T06:26:14.982 INFO:scrape:Failure: Command failed (workunit test kernel_untar_build.sh) on smithi130 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2023-07-09T06:26:14.982 INFO:scrape:1 jobs: ['7329430'] 2023-07-09T06:26:14.983 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}'] 2023-07-09T06:26:14.983 INFO:scrape: 2023-07-09T06:26:14.983 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2023-07-09T06:26:14.984 INFO:scrape:1 jobs: ['7329401'] 2023-07-09T06:26:14.985 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] 2023-07-09T06:26:14.985 INFO:scrape: 2023-07-09T06:26:14.986 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi090 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh' 2023-07-09T06:26:14.987 INFO:scrape:1 jobs: ['7329520'] 2023-07-09T06:26:14.987 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health}'] 2023-07-09T06:26:14.988 INFO:scrape: 2023-07-09T06:26:14.989 INFO:scrape:Failure: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-07-09T06:26:14.989 INFO:scrape:1 jobs: ['7329479'] 2023-07-09T06:26:14.990 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/no', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-quota}'] 2023-07-09T06:26:14.990 INFO:scrape: 2023-07-09T06:26:14.990 INFO:scrape:Failure: Command failed (workunit test fs/quota/quota.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-07-09T06:26:14.991 INFO:scrape:1 jobs: ['7329519'] 2023-07-09T06:26:14.991 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_20.04}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/workunit/quota}'] 2023-07-09T06:26:14.991 INFO:scrape: 2023-07-09T06:26:14.991 INFO:scrape:Valgrind: mon (InvalidRead, Leak_PossiblyLost, Leak_StillReachable) 2023-07-09T06:26:14.992 INFO:scrape:1 jobs: ['7329475'] 2023-07-09T06:26:14.992 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu/{latest', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'overrides}}', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}'] 2023-07-09T06:26:14.993 INFO:scrape: 2023-07-09T06:26:14.993 INFO:scrape:Failure: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays) 2023-07-09T06:26:14.993 INFO:scrape:1 jobs: ['7329499'] 2023-07-09T06:26:14.993 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/strays}'] 2023-07-09T06:26:14.994 INFO:scrape: 2023-07-09T06:26:15.008 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/ failed: 17 dead: 5 running: 0 waiting: 0 queued: 0 passed: 172 Fail ================================================================= [7329389] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} ----------------------------------------------------------------- time: 00:10:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329389/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329389/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e02cb74fd72420ea9d88e60a0a693f7 Command failed on smithi158 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp' [7329392] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} ----------------------------------------------------------------- time: 00:10:29 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329392/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329392/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84fe7b6483e9486ab8c9143a6a6a2b6f Command failed on smithi093 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp' [7329401] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} ----------------------------------------------------------------- time: 01:23:52 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329401/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329401/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e09e02f6b2484fd589d6dd08a3b051ab Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) [7329426] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} ----------------------------------------------------------------- time: 00:14:56 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329426/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329426/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d5c769a942f942d0a26812e9bca00757 Command failed on smithi186 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7329430] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} ----------------------------------------------------------------- time: 00:31:46 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329430/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329430/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54d7c7f1f82c46f996681d4fd7b1ce48 Command failed (workunit test kernel_untar_build.sh) on smithi130 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' [7329448] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/direct_io}} ----------------------------------------------------------------- time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329448/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329448/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a90da98ba74406a886ac3530420d077 Command failed on smithi104 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:8507faa7ce284e46218d481e3ee9c411ac3dc32c pull' [7329451] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:34:22 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329451/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329451/ "2023-07-08T17:48:55.638410+0000 mon.a (mon.0) 2852 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [7329457] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} ----------------------------------------------------------------- time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329457/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae6a8f4fbe944a089428809fb35be7b4 Command failed on smithi100 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7329474] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 06:22:38 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329474/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329474/ sentry: https://sentry.ceph.com/organizations/ceph/?query=798a31607eaa4488b72ae87190c17e4b Command failed (workunit test suites/fsstress.sh) on smithi003 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh' [7329475] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 01:59:02 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329475/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b931a686fed042e0b0cc7a7b53e3e8c1 saw valgrind issues [7329479] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} ----------------------------------------------------------------- time: 01:29:30 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329479/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329479/ error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds [7329499] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} ----------------------------------------------------------------- time: 00:37:45 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329499/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329499/ sentry: https://sentry.ceph.com/organizations/ceph/?query=768956d133fa47749ca0fe607bc6e1f7 Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays) [7329519] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} ----------------------------------------------------------------- time: 00:14:25 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329519/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2665aa8a43bd4c118fb398d50330414f Command failed (workunit test fs/quota/quota.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' [7329520] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} ----------------------------------------------------------------- time: 00:32:12 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329520/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329520/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6369abea20ef42c4aaba07dac862321c Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi090 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8507faa7ce284e46218d481e3ee9c411ac3dc32c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest- multiple-capsnaps.sh' [7329522] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} ----------------------------------------------------------------- time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329522/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329522/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f06103840f54d13b916115b56cdc3fe Command failed on smithi143 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7329527] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} ----------------------------------------------------------------- time: 01:06:07 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329527/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329527/ "2023-07-08T18:47:52.012253+0000 mon.a (mon.0) 2695 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [7329552] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} ----------------------------------------------------------------- time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329552/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329552/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6890971217294d9eb5e53876e2a44ff3 Command failed on smithi137 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' Dead ================================================================= [7329386] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329386/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329386/ hit max job timeout [7329406] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329406/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329406/ hit max job timeout [7329490] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329490/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329490/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7329533] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329533/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329533/ hit max job timeout [7329558] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329558/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329558/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7329374] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} time: 00:17:29 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329374/ [7329375] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} time: 00:23:52 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329375/ [7329376] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:39 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329376/ [7329377] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} time: 00:25:10 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329377/ [7329378] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} time: 00:15:18 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329378/ [7329379] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:29:22 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329379/ [7329380] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} time: 00:41:18 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329380/ [7329381] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329381/ [7329382] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsync-tester}} time: 00:40:31 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329382/ [7329383] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329383/ [7329384] fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} time: 00:13:57 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329384/ [7329385] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host} time: 00:51:27 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329385/ [7329387] fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} time: 00:20:52 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329387/ [7329388] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} time: 00:22:50 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329388/ [7329390] fs/mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{rhel_8} tasks/mirror} time: 02:03:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329390/ [7329391] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:23:34 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329391/ [7329393] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:58:40 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329393/ [7329394] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} time: 00:37:36 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329394/ [7329395] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:16:48 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329395/ [7329396] fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} time: 00:45:11 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329396/ [7329397] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:59:08 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329397/ [7329398] fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{centos_8} tasks/fstop} time: 00:19:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329398/ [7329399] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:22:37 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329399/ [7329400] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:28:07 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329400/ [7329402] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:53:17 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329402/ [7329403] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:34:29 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329403/ [7329404] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} time: 00:14:46 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329404/ [7329405] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} time: 00:53:49 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329405/ [7329407] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}} time: 00:42:35 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329407/ [7329408] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329408/ [7329409] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} time: 00:42:04 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329409/ [7329410] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329410/ [7329411] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} time: 00:13:26 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329411/ [7329412] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} time: 00:27:10 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329412/ [7329413] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} time: 00:32:52 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329413/ [7329414] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} time: 00:46:06 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329414/ [7329415] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329415/ [7329416] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}} time: 01:04:21 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329416/ [7329417] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:27:48 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329417/ [7329418] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} time: 00:52:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329418/ [7329419] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:16:22 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329419/ [7329420] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329420/ [7329421] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:19:47 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329421/ [7329422] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329422/ [7329423] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}} time: 00:31:01 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329423/ [7329424] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:19:11 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329424/ [7329425] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} time: 00:22:20 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329425/ [7329427] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 00:56:50 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329427/ [7329428] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:56:37 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329428/ [7329429] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} time: 00:24:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329429/ [7329431] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 00:51:53 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329431/ [7329432] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:16:45 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329432/ [7329433] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329433/ [7329434] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:23:34 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329434/ [7329435] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-dbench} time: 01:17:51 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329435/ [7329436] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} time: 00:36:46 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329436/ [7329437] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329437/ [7329438] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} time: 00:35:05 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329438/ [7329439] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:49 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329439/ [7329440] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:26:07 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329440/ [7329441] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep} time: 00:24:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329441/ [7329442] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} time: 00:24:54 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329442/ [7329443] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:16:48 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329443/ [7329444] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb} time: 00:12:32 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329444/ [7329445] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:18:07 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329445/ [7329446] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} time: 00:51:08 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329446/ [7329447] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} time: 00:18:45 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329447/ [7329449] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 00:57:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329449/ [7329450] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:28:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329450/ [7329452] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} time: 00:21:13 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329452/ [7329453] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329453/ [7329454] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} time: 01:16:44 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329454/ [7329455] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} time: 01:34:54 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329455/ [7329456] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} time: 00:18:08 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329456/ [7329458] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} time: 00:33:22 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329458/ [7329459] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:43:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329459/ [7329460] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} time: 01:47:59 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329460/ [7329461] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} time: 00:34:32 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329461/ [7329462] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:26:39 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329462/ [7329463] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} time: 00:15:52 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329463/ [7329464] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:17:30 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329464/ [7329465] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:45:15 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329465/ [7329466] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329466/ [7329467] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:36:26 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329467/ [7329468] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 01:36:07 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329468/ [7329469] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329469/ [7329470] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} time: 00:51:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329470/ [7329471] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:41:22 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329471/ [7329472] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-ffsb} time: 02:03:59 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329472/ [7329473] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329473/ [7329476] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} time: 00:30:01 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329476/ [7329477] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:22:44 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329477/ [7329478] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:20:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329478/ [7329480] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} time: 00:21:47 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329480/ [7329481] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} time: 00:59:27 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329481/ [7329482] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} time: 01:14:39 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329482/ [7329483] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329483/ [7329484] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} time: 00:58:06 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329484/ [7329485] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:16:17 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329485/ [7329486] fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health} time: 00:21:10 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329486/ [7329487] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir} time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329487/ [7329488] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329488/ [7329489] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} time: 00:58:55 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329489/ [7329491] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:16:00 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329491/ [7329492] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:14:17 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329492/ [7329493] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:21:37 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329493/ [7329494] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} time: 00:42:34 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329494/ [7329495] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} time: 00:31:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329495/ [7329496] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:38:13 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329496/ [7329497] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} time: 00:19:47 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329497/ [7329498] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} time: 00:22:55 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329498/ [7329500] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:44:54 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329500/ [7329501] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:18:12 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329501/ [7329502] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329502/ [7329503] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} time: 01:13:40 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329503/ [7329504] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-workload/new_ops/{0-clients/kclient 1-client-sanity}}} time: 00:14:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329504/ [7329505] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} time: 00:28:48 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329505/ [7329506] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:49 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329506/ [7329507] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} time: 00:17:48 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329507/ [7329508] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:17:18 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329508/ [7329509] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-iozone} time: 02:29:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329509/ [7329510] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} time: 00:14:17 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329510/ [7329511] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} time: 00:20:09 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329511/ [7329512] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329512/ [7329513] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} time: 01:28:55 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329513/ [7329514] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} time: 00:47:41 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329514/ [7329515] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:19:59 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329515/ [7329516] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329516/ [7329517] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:37:38 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329517/ [7329518] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:39:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329518/ [7329521] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} time: 00:17:20 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329521/ [7329523] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329523/ [7329524] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 00:41:35 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329524/ [7329525] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} time: 00:41:19 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329525/ [7329526] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} time: 00:22:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329526/ [7329528] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} time: 00:27:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329528/ [7329529] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329529/ [7329530] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} time: 00:38:36 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329530/ [7329531] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} time: 00:26:36 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329531/ [7329532] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} time: 00:28:46 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329532/ [7329534] fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} time: 00:41:01 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329534/ [7329535] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:16:29 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329535/ [7329536] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} time: 00:14:49 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329536/ [7329537] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:30:09 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329537/ [7329538] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} time: 00:21:24 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329538/ [7329539] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:29:21 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329539/ [7329540] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} time: 01:43:35 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329540/ [7329541] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} time: 00:15:57 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329541/ [7329542] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} time: 00:40:39 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329542/ [7329543] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} time: 00:18:35 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329543/ [7329544] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329544/ [7329545] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:36:38 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329545/ [7329546] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} time: 00:40:31 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329546/ [7329547] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-pjd} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329547/ [7329548] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} time: 00:13:57 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329548/ [7329549] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:22:05 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329549/ [7329550] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/lockdep} time: 00:53:12 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329550/ [7329551] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} time: 00:23:54 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329551/ [7329553] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} time: 00:57:10 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329553/ [7329554] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} time: 01:13:36 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329554/ [7329555] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:19:42 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329555/ [7329556] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:22:30 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329556/ [7329557] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329557/ [7329559] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} time: 00:35:16 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329559/ [7329560] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} time: 00:17:42 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329560/ [7329561] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329561/ [7329562] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:45 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329562/ [7329563] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} time: 00:19:28 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329563/ [7329564] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} time: 00:42:34 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329564/ [7329565] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} time: 00:27:39 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329565/ [7329566] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:18:04 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329566/ [7329567] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/test_o_trunc}} time: 00:35:38 info: http://pulpito.ceph.com/yuriw-2023-07-08_15:05:02-fs-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7329567/