2022-06-30T03:52:42.759 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-06-30T03:52:42.762 INFO:teuthology.results:seed: '2470' 2022-06-30T06:11:19.626 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-06-30T06:11:19.676 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-30T16:38:14.089 INFO:teuthology.results:Tests finished! gathering results... 2022-06-30T16:38:24.536 INFO:scrape:Found 96 jobs 2022-06-30T16:38:30.922 INFO:scrape:Found 7 distinct failure reasons 2022-06-30T16:38:30.923 INFO:scrape:Failure: '2022-06-30T04:52:01.646371+00:00 smithi046 kernel: kernel BUG at mm/filemap.c:1559! ' in syslog 2022-06-30T16:38:30.924 INFO:scrape:1 jobs: ['6906744'] 2022-06-30T16:38:30.924 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/5', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/no}'] 2022-06-30T16:38:30.925 INFO:scrape: 2022-06-30T16:38:30.925 INFO:scrape:Failure: {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-06-30T16:38:30.926 INFO:scrape:52 jobs 2022-06-30T16:38:30.927 INFO:scrape:suites intersection: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd-asserts', 'osd}', 'overrides/{frag', 'session_timeout}', 'standby-replay'] 2022-06-30T16:38:30.927 INFO:scrape:suites union: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{base/{mount-syntax/{v1}', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/legacy', 'ms_mode/secure', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/1', 'ranks/3', 'ranks/5', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'tasks/{0-subvolume/{with-namespace-isolated}', 'tasks/{0-subvolume/{with-no-extra-options}', 'tasks/{0-subvolume/{with-quota}', 'wsync/no}', 'wsync/yes}'] 2022-06-30T16:38:30.928 INFO:scrape: 2022-06-30T16:38:30.928 INFO:scrape:Dead: b'2022-06-30T16:30:31.443 DEBUG:teuthology.exit:Finished running handlers' 2022-06-30T16:38:30.929 INFO:scrape:1 jobs: ['6906768'] 2022-06-30T16:38:30.929 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/3', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'wsync/no}'] 2022-06-30T16:38:30.930 INFO:scrape: 2022-06-30T16:38:30.931 INFO:scrape:Failure: Command failed on smithi046 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2022-06-30T16:38:30.931 INFO:scrape:2 jobs: ['6906802', '6906803'] 2022-06-30T16:38:30.932 INFO:scrape:suites intersection: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/5', 'session_timeout}', 'standby-replay', 'wsync/no}'] 2022-06-30T16:38:30.932 INFO:scrape:suites union: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/secure', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/5', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'wsync/no}'] 2022-06-30T16:38:30.933 INFO:scrape: 2022-06-30T16:38:30.933 INFO:scrape:Failure: {'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-06-30T16:38:30.933 INFO:scrape:3 jobs: ['6906777', '6906792', '6906753'] 2022-06-30T16:38:30.934 INFO:scrape:suites intersection: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'session_timeout}', 'standby-replay', 'wsync/no}'] 2022-06-30T16:38:30.934 INFO:scrape:suites union: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/secure', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/1', 'ranks/5', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}', 'tasks/{0-subvolume/{with-no-extra-options}', 'wsync/no}'] 2022-06-30T16:38:30.935 INFO:scrape: 2022-06-30T16:38:30.935 INFO:scrape:Failure: Command failed on smithi017 with status 1: 'sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm' 2022-06-30T16:38:30.936 INFO:scrape:1 jobs: ['6906746'] 2022-06-30T16:38:30.936 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/5', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated}', 'wsync/no}'] 2022-06-30T16:38:30.937 INFO:scrape: 2022-06-30T16:38:30.937 INFO:scrape:Failure: The following counters failed to be set on mds daemons: {'mds_server.req_rmsnap_latency.avgcount'} 2022-06-30T16:38:30.937 INFO:scrape:1 jobs: ['6906758'] 2022-06-30T16:38:30.938 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/no', '3-snaps/yes', '4-workunit/db/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs:workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'ranks/5', 'rhel_8}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{no-subvolume}', 'wsync/yes}'] 2022-06-30T16:38:30.939 INFO:scrape: 2022-06-30T16:38:30.944 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/ failed: 7 dead: 54 running: 0 waiting: 0 queued: 0 passed: 35 Fail ================================================================= [6906744] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 01:42:02 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906744/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906744/ '2022-06-30T04:52:01.646371+00:00 smithi046 kernel: kernel BUG at mm/filemap.c:1559! ' in syslog [6906746] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906746/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906746/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba533acfd3264db19cd2b51abdab2569 Command failed on smithi017 with status 1: 'sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm' [6906758] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:55:05 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906758/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906758/ The following counters failed to be set on mds daemons: {'mds_server.req_rmsnap_latency.avgcount'} [6906784] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906784/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906784/ sentry: https://sentry.ceph.com/organizations/ceph/?query=102da213d7754575ae06b5ed638d99f3 {'smithi019.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906793] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906793/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906793/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3020b25edb914f8390cf15808438a4d8 {'smithi019.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906802] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 01:45:19 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906802/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906802/ Command failed on smithi046 with status 1: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' [6906803] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 01:20:58 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906803/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906803/ Command failed on smithi008 with status 1: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' Dead ================================================================= [6906729] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:23 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906729/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906729/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dfc5081b69ea4d3eb1ed340530f33e29 {'smithi006.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906730] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:24 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906730/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906730/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff2bd46829054de0b211b42d348f9a1b {'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906731] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:29 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906731/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906731/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07a115a0068d4ca18a59650d24ac1336 {'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906735] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:21 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906735/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906735/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6d84b5b7ce84fe391a2fb1701c97e64 {'smithi085.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906736] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906736/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906736/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b54f3ff228c47d7a8bc6c3d00fa8219 {'smithi062.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906737] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:22 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906737/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906737/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a51af3f218254b4196a12ce9055b25b9 {'smithi003.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906738] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:05:38 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906738/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906738/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0c622b5baec49bf81a52558879fba31 {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906739] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906739/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906739/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41e15b0fb16a4e469ceb53b0ec688d7e {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906740] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:27 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906740/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906740/ sentry: https://sentry.ceph.com/organizations/ceph/?query=586913dc6387466fa516703a0c027310 {'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906745] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906745/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906745/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df9560bdb8f2404f85cd19a02fb1abe4 {'smithi100.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906747] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:20 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906747/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=787c6d7087a94eb4b748ef650e5409f0 {'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906752] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906752/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906752/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eea4151886be4361b99b4e010f57d0db {'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906753] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:02:58 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906753/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906753/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7a43b00eb7a4a5995d7d0992a6939f3 {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906754] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906754/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906754/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d8f236603364960a06703881e12aae1 {'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906755] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906755/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906755/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58e6a26e8db9411e8b2e59be9d909f08 {'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906760] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906760/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906760/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e524e1c0835c431cb5131a2d27949d4b {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906761] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:20 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906761/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906761/ sentry: https://sentry.ceph.com/organizations/ceph/?query=188dec1ad8384cc3a6fdac5ae33ea58d {'smithi117.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906762] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:05:34 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906762/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906762/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a75af5dbff034f599b3005ce122278ac {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906763] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906763/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906763/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6eadc589d78a4060bfa7ea8e0dc8d7b0 {'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906767] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:08 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906767/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906767/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e1eb2658fea411fb757f2e28009b203 {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906768] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906768/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906768/ hit max job timeout [6906769] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:08 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906769/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906769/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5c5d95e508346798b8db79b2c6f678c {'smithi079.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906770] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:08 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906770/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906770/ sentry: https://sentry.ceph.com/organizations/ceph/?query=937affe4503b43e09f8bf6111d4102fb {'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906771] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:12 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906771/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906771/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a8e67d537744de8bdbb41342ed82f51 {'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906772] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:06 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906772/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906772/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ae65fd8b62d40e1a3620e7e033b8120 {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906774] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:08 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906774/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6cf51f2a655c4bf9913e4a0bb173dc21 {'smithi039.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906776] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906776/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906776/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31f2aeae80fb4b928024d772dd1a15d5 {'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906777] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:02:58 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906777/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906777/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5465f40ede81455ea21b4f0de20a21f8 {'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906778] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:08 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906778/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906778/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d0727ad738349219bd3c9d67e21e093 {'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906779] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906779/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906779/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba6ac20c3c244ea0937d5324f81b191b {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906782] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:03:55 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906782/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906782/ sentry: https://sentry.ceph.com/organizations/ceph/?query=deb0a9d6462543b9bc705e8c5ad97c0e {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi039.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906783] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:04 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906783/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906783/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afe0b4bcb6264845a897aef345ab42a2 {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906785] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906785/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906785/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e6b539b14d74120891a662cc83d50d0 {'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906786] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906786/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906786/ sentry: https://sentry.ceph.com/organizations/ceph/?query=04187617fc64431ebf29930ab8b264be {'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906787] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906787/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906787/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5697dcc247f94042af55781d6da65483 {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906791] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906791/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906791/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1dbe22c60f4243b8a5fbbe162b6f9acd {'smithi064.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906792] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:02:58 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906792/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906792/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8af104ada8843ef8b30f86bb616a1df {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906794] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:49 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906794/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906794/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bd31160be8a42d7b6bd3d167935d749 {'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906795] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:43 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906795/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906795/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de1280a6fb824d1ab621a7d0ff1297eb {'smithi090.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906796] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:42 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906796/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906796/ sentry: https://sentry.ceph.com/organizations/ceph/?query=add0377a4afe48ecb8504050208d1d9f {'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906798] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:44 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906798/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906798/ sentry: https://sentry.ceph.com/organizations/ceph/?query=479defdfa7084a6b92339c27709ee8c1 {'smithi055.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906800] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:46 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906800/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906800/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da5f95390f264fbcb6d5b7c9e38499c9 {'smithi017.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906801] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:49 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906801/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906801/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8026d78c0ec64bec95aa4a2a04663904 {'smithi103.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906807] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:32 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906807/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906807/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f346f4ee7ad44094bd63403a29ac1b1e {'smithi090.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906808] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:41 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906808/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906808/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3afd8f9464734d9baecc07ee46f99694 {'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906809] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:41 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906809/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906809/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d98ef02deef421488bcf1e424508539 {'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906810] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906810/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=754e54e36804498b972e902442adc208 {'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906811] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:36 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906811/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906811/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ebffa939e5a444e49b7d8e9af805d5b2 {'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi047.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906815] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:33 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906815/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d91234e671d4e8b98c42eebb9e8eb79 {'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906816] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906816/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906816/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a92f3c2e72ad44a083e7ef9dbe32bfa9 {'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906817] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906817/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906817/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed258ba4dd674245a236dea4b4451b3a {'smithi017.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906818] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:34 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906818/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f856fca23ec549ce9c8197d28f32bdfa {'smithi134.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi103.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906819] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:37 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906819/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906819/ sentry: https://sentry.ceph.com/organizations/ceph/?query=facc0566f57e46bcbeca38df78b6ff7d {'smithi032.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi005.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6906821] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} ----------------------------------------------------------------- time: 00:04:38 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906821/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906821/ sentry: https://sentry.ceph.com/organizations/ceph/?query=615ae6562b7740279de42f61fd4ac8a1 {'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [6906728] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:40:29 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906728/ [6906732] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:59:44 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906732/ [6906733] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:53:22 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906733/ [6906734] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:01:42 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906734/ [6906741] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:42:15 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906741/ [6906742] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:54:19 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906742/ [6906743] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:32:14 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906743/ [6906748] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:57:28 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906748/ [6906749] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:49:45 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906749/ [6906750] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:11:59 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906750/ [6906751] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:05:33 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906751/ [6906756] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:47:38 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906756/ [6906757] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:41:54 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906757/ [6906759] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:23:51 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906759/ [6906764] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:58:02 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906764/ [6906765] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:54:27 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906765/ [6906766] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:04:47 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906766/ [6906773] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:40:06 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906773/ [6906775] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:23:32 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906775/ [6906780] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:58:38 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906780/ [6906781] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:51:41 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906781/ [6906788] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:41:30 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906788/ [6906789] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:41:12 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906789/ [6906790] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:55:45 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906790/ [6906797] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:54:44 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906797/ [6906799] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:02:58 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906799/ [6906804] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:46:29 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906804/ [6906805] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:43:14 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906805/ [6906806] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:52:52 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906806/ [6906812] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:04:19 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906812/ [6906813] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 00:54:03 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906813/ [6906814] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:06:38 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906814/ [6906820] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:39:11 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906820/ [6906822] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 02:00:30 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906822/ [6906823] fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} time: 01:38:29 info: http://pulpito.ceph.com/pdonnell-2022-06-30_03:50:41-fs:workload-wip-pdonnell-testing-20220630.004912-distro-default-smithi/6906823/